Congratulations on being selected for GSoC 2022! Use this topic for all communications this summer. No private messages should happen. Use the Jitsi link below if you need to have real-time discussions with your mentors.
@sshivaditya You will be working on this project. Please let me know what time works for you so that we can schedule a meeting. We will conduct meeting on forum itself.
Does Sunday 9:30 PM IST work for you ?
10:30 PM IST works for me
1 Like
Project Weekly brief:
- Handheld and Gesture Based Controllers are to be used
- Vitals are to be obtained from the Mock API
- Radiography has to be in sync with the video.
- Chat Will record voice annotations which would then be answered by attending surgeon/Doctor or ML Model
- Image size would 224x224
- Video Controls should be able to rewind and play from the live stream on pause/play subsequently
Blockers: None as of Now
Tasks for the week:
- Design a Mockup in Unity with static content for the initial phase
This week’s progress. Initial Static Mockup Design Complete. All the textures are designed in blender.
@pri2si17 Pulse Physiology Engine | Integration | Unity Asset Store Can I use this package/asset in the project. For drawing the vital chart we can use with thispackage
Additional Links:
Regarding Chat Functionality
For Video Delivery the following SDK can be tried
This week’s blog post
One other idea: Why not make it Matrix-based? We might adopt Matrix at some point as a replacement for Rocket Chat.
Edit: Nevermind.
1 Like
Project Weekly brief:
- Simple Chat App using TCP and Sockets designed using unity.
- Chat app made in 2d Non VR mode. (In order to test multi-client communication)
- UI for Chat Pane in VR is in progress
Blockers: None as of now
Tasks for the week:
- Complete the Chat UI interface in VR and test
Hi @sshivaditya please use following repo for the chat:
LibreHealth / LibreHealth Radiology / lh-radiology-vr-chat · GitLab
Project Weekly brief:
- Completed Chat UI completely
- Tested Oculus Integrations SDK with Existing UI
- Designed Voice Recording and subsequent conversion to byte stream pipeline
Blockers:
- Oculus Integrations SDK offers out of box Hand Tracking instead of controllers. The existing UI elements are not working with the SDK. Pulse Physiology is also facing issues while rendering. All of these issues do not exist with Unity’s XR Interaction toolkit.
Tasks for week:
- Revert back to Unity XR interaction toolkit
- Work on Chat UI Pipeline
- Complete the Voice Chat Code
Hi @sshivaditya , thanks for the update. Can you please provide update for this week on the forum itself and can you please share an screen recording of the working chat app? I will meet you next week.
