Scan Manager

Scan Manager is the result of my time spent interning with Go Reply. It is an application built on Google Cloud Platform and made use of a variety of Google Products. It allows users to store and view their medical data, currently allowing them to upload text, NIfTI or DICOM files. Once a text file is stored, the user is given the option to have the contents of the file summarised by Generative AI.

DICOM files are what imaging machines (like an MRI machine) would produce. Users can upload a zip of DICOM files (each file represents one slice of the 3D image). The files are sorted and stored, and then users can view their scans by making use of the OHIF viewer - this is an open source tool that allows for industry standard quality when viewing DICOM files.

Users can also upload NIfTI files - these are compressions of a set of DICOM files, representing a 3D scan as a single entity. Users can scroll through the slices of the NIfTI scan, selecting a slice and ask for Generative AI to give some insights into it.

It also allows for Doctors to manage their patients scans/accounts.

The application also supports authentication with official Google Accounts by making use of Firebase and initialising a session for each logged in user to ensure that they can only access what they are allowed to.

The application also has a chatbot that was trained to only have knowledge on MRI scans (to answer basic questions), and how the application works (to aid users).

The key Google products used were Cloud Storage (storing text and NIfTI files), Vertexai (for Generative AI), Firestore (for storing users/scan info and helping with authentication), Healthcare API (storing and sorting DICOM files), Dialogflow (chatbot), Cloud Functions (some backend features) and Cloud Run (hosting the Flask application and the OHIF viewer docker images).

This project was presented back to the rest of Go, including the partners. This presentation included both a technical review/handover as well as a non-technical mock client offering.