This post presents the project’s technical report with in depth details of the development process as well as explanations on how the system works as a whole. Furthermore, here is a presentation video going over the project. Presentation Video Technical Report Previous Next / [pdf] View the PDF file here.
This week, the team prepared a presentation as a blueprint for the actual final presentation. It included a slideshow and a demonstration video covering the project details in a holistic approach. Here are the slideshow and video, respectively. Slideshow https://docs.google.com/presentation/d/1bSWciEHRcWuzinr5j28ol0cN9dWHmcow/edit?usp=sharing&ouid=112921246561352075323&rtpof=true&sd=true Video
This week, the team focused on integrating all parts of the system, making them work together. That entailed making the communication between the totem and the server work, as well as between the Raspberry Pi and the ESP32 and between the Raspberry Pi and the tablet UI. Although that integration is now mostly done, there are some more tests that still need to be done.
Software This week, the team focused on finishing the project’s software implementation. Here are pictures taken from the frontend of the application where employees can manage and view patients and reports. Login page Register page Authorization page Patients waiting for treatment page Patient history page Report page
This week, the team’s effort was channeled towards finishing the electronical implementation, aswell as begining the software implementation. Electronics Board Improved Schematics Software Backend In terms of software, we have finished implementing the backend, which is composed of 2 different services: the Storate Service, that handles patients, reports and employees, and the Audio and Text Service, which exposes endpoints for Speech To Text (STT) and Text To Speech (TTS) . ...
For this deliverable, the team focused mainly on implementing the complete mechanical solution, allowing the drawer and door to be opened automatically through the servomotors. Apart from that, we started to work towards implementing the electronic and hardware project, which involves collecting data from the sensors, implementing peripheral functionality, etc. Last but not least, we finished the complete Software design, including the User Interface and system architecture. Mechanics and Electronics Servomotors Servomotor functioning from the front Your browser does not support the video tag. Servomotor functioning from the back Your browser does not support the video tag. Software design Diagrams Totem Activity Diagram ...
Overview This week, the main activities developed were about constructing the mechanical structure, designing the electronic project and testing the electronics. Mechanical structure Laser Cutting of the MDF sheets Front view without front plate Full structure Electronics design
Overview This week, the team worked on buying all of the components that will be needed for the project. Apart from that, the week’s work was divided in four main fronts: Mechanical design Backend design Pressure monitor reverse engineering Experimenting with Text to Speech (TTS) and Speech to Text (STT) solutions Mechanical design Here is the mechanical design so far ...
Functional Requirements Hardware FR1 - The system must measure the patient’s body temperature. FR2 - The system must measure the patient’s heart rate. FR3 - The system must measure the patient’s oxygen saturation. FR4 - The system must measure the patient’s blood pressure. FR5 - The system must have audio output. FR6 - The system must have audio input. FR7 - The system must control if the doors should open or close. FR8 - The system must have a screen. FR9 - The system must have WiFi connection. FR10 - The system must indicate visually when the patient should speak. FR11 - The system must be plugged into the outlet. Mechanical FR12 - The system must have space to contain an oximeter and cardiac frequency sensor. FR13 - The system must have space to contain blood pressure equipment. FR14 - The system must have space to contain a temperature sensor. FR15 - The system must have space to contain a microphone. FR16 - The system must have space to contain a sound box. FR17 - The system must have at least 2 spaces to contain a speaker. FR18 (Non obligatory) - The system must have space to contain a camera. FR19 - The space that contains the blood pressure equipment should have a little door. FR20 - The space that contains the oximeter and cardiac frequency sensor should have a little door. FR21 - Both doors must lock when closed. FR22 - The system must have a space for a screen. FR23 - The drawer opening will be controlled by a servo motor. FR24 - The door opening will be controlled by a servo motor. Software FR25 - The system must contain a website where healthcare professionals can access patients’ information. FR26 - The website must have a login page. FR27 - The website must allow users to authenticate to get access. FR28 - The website must allow users to search for patient’s medical screenings. FR29 - The website must allow users to see all collected data in a patient’s medical screening. FR30 - The website must allow users to see a patient’s medical screening history. FR31 - The website must allow users to export a patient’s medical record as a PDF. FR32 - The website must manage sessions and keep users logged in. FR33 - The website must have admin users who can manage less privileged users. FR34 - The website must allow new authorized users to register. General FR35 - The system must identify patients via name and CPF. FR36 - The system must communicate via audio with the patient. FR37 - The system must be voice-controlled. FR38 - The system must show the questions in text form on the screen. FR39 - The system must start the medical screening after a specific voice command. FR40 - The communication between the system and the patient should be in English. FR41 - The system must ask pre-defined questions at the beginning of the medical screening. FR42 - The system must elaborate questions intelligently based on the patient’s complaints. FR43 - The system must give the patient instructions about how to get vital signs monitored. FR44 - The system must show heart rate being measured in real time. FR45 - The system must show oxygen levels being measured in real time. FR46 - The system must show temperature being measured in real time. FR47 - The system must end the medical screening by timeout or user’s command. FR48 - The system must keep a history of a patient’s medical screenings. FR49 (Non obligatory) - The system must detect the presence of a patient via camera. FR50 (Non obligatory) - The system must perform person recognition via camera. Non Functional Requirements NFR1 - All hinges and locks must be made from non-brittle materials to avoid cracking under stress. ...
Functional Requirements Hardware FR1 - The system must measure the patient’s body temperature. FR2 - The system must measure the patient’s heart rate. FR3 - The system must measure the patient’s oxygen saturation. FR4 - The system must measure the patient’s blood pressure. FR5 - The system must have audio output. FR6 - The system must have audio input. FR7 - The system must control if the doors should open or close. FR8 - The system must have a screen. FR9 - The system must have WiFi connection. FR10 - The system must indicate visually when the patient should speak. FR11 - The system must be plugged into the outlet. Mechanical FR1 - The system must have space to contain an oximeter and cardiac frequency sensor. ...