Welcome to the Endeavour Health knowledge base: Difference between revisions

From Endeavour Knowledge Base
No edit summary
(23 intermediate revisions by the same user not shown)
Line 3: Line 3:


These articles describe the various technologies underpinning the Endeavour and Discovery open source systems and related operational services which are currently live.  
These articles describe the various technologies underpinning the Endeavour and Discovery open source systems and related operational services which are currently live.  
==What is the Discovery idea?==
==Discovery Data Service and information model==
Discovery is based on the hypothesis that; If health related data is brought together at the level of the individual in close to real time, and stored together at the level of a medium size residential population, and made available via a common data model that uses a common ontology of concepts, and then subsequently used for individual and population based decision support, great benefits to health can accrue.
Discovery is based on the hypothesis that; If health related data is brought together at the level of the individual in close to real time, and stored together at the level of a medium size residential population, and made available via a common data model as part of a common ontology, and then subsequently used for individual and population based decision support, great benefits to health can accrue.


The idea is not new. What is different about the approach to many alternatives, is that the specially developed software is open source and available for anyone to use. Specially developed software relates to any specialised software that is required to achieve the objective where that software is not available as part of generic cloud commodity services or data storage technologies.  
Discovery consists of a set of technology components that link near real time data from millions of records from thousands of provider organisations, as well as an information model consisting of a set of ontologies and a common data model. All the technologies that have been developed are open source and available for anyone to use.  


The idea is also differentiated from the commonly used approach of linking end of month reporting data such as SUS or HES. Instead, Discovery seeks to use data as close as possible to its original entry form as entered by health professionals or the citizen themselves, and to use that data as close to real time as the publishers of that data can make available.
Discovery forms the basis of an NHS owned data service called the Discovery data service (we like nautical things) , operating across the city of London, covering 3 ICSs and a residential population of 7.5 million citizens. The service seeks to use data as close as possible to its original entry form as entered by health professionals or the citizen themselves, and to use that data as close to real time as the publishers of that data can make available.


== Information modelling topics ==
== Information model Components ==
These articles provide information about the services, structure, and functionality that operate using the Information Models; one of the fundamental tenets of the Discovery Data Service. This is the starting point for those interested in health data and the information derived from it, and why Discovery may be different from other approaches:
These articles provide information about the software used by Endeavour- Discovery and the information modelling processes that these support.


*[[Discovery health information model|Health Information model]] - An overview of the approach to the Discovery information model,  the purpose, and type of content.
*[[Discovery health information model|Health Information model]] - An overview of the approach to the Discovery information model,  the purpose, and type of content.
*[[Health Information modelling language|Modelling language]] - The W3C standard languages used to build the various components of the information model
*[[Health Information modelling language|Information model language]] - The Semantic Web languages and domain specific languages used to build the various components of the information models
*[[Health_data_model_content|Basic health data set ]] - a very high level overview of the types of data mapped from data held  within the Discovery data stores.
*[[Querying data|Real data query]] - The relationship between the various information model artefacts and how actual health and care data in systems would be queried using the models
*[[Information model reference data|Reference data -]] an overview of additional data held in the information model.
*[[Mapping and matching concepts|Mapping concepts and transforming published data]] - Introduces the approaches to matching and mapping concepts and the structural maps used in transforming published data,
*[[Mapping and matching concepts|Mapping and matching concepts and structures]] - Introduces the approaches to matching and mapping concepts and the structural mappings in the model
*[[Architectures|Architectures -]] A high level overview of the architectures that the technologies contribute to
*[[Information_model_service|Information model services]] - the technical services , such as APIs and apps that enable an model instance to be used or to implement an EHR based on the model or particular data model
*[[GitHub repositories]] - descriptions and information relating to the application source code, .


== Services ==
== Services ==


* [[London Discovery data service.]] Provides information about a set of services that use these technologies under the general term "Discovery data service".
*[https://wiki.discoverydataservice.org/index.php?title=Welcome_to_the_Discovery_Data_Service_knowledge_base London Discovery data service.] Provides information about the London NHS service that are based on these technologies.
*
* [[ASSIGN- UPRN address match application|ASSIGN - UPRN]]. An address matching application and service that matches addresses held in source systems in various forms, to the addresses made available under license by the Ordnance Survey and Post office, including the assigning of a URPN. The application and service has been jointly developed by the Endeavour Health Charitable trust and Queen Mary's University of London and the Clinical effectiveness Group (CEG)  
* [[ASSIGN- UPRN address match application|ASSIGN - UPRN]]. An address matching application and service that matches addresses held in source systems in various forms, to the addresses made available under license by the Ordnance Survey and Post office, including the assigning of a URPN. The application and service has been jointly developed by the Endeavour Health Charitable trust and Queen Mary's University of London and the Clinical effectiveness Group (CEG)  
*[[Information_model_service|Information model services]] - the technical services , such as APIs and apps that enable an model instance to be used or to implement an EHR based on the model or particular data model
*[[FHIR Get Structured Record API|Get Structured Record API]] - returns a complete patient record in a structured format following GP and Care Connect standards.
*[[Discovery Query|Sextant]] - A data set distribution service with an option to post the data directly into the recipients database.
*[[Case studies|Data Distribution services]] that distribute daily weekly or adhoc small data sets from the Discovery core data stores with examples from 2020


= Discovery overview =
= Applications =
 
These articles provide background to the ideas, philosophies and approaches that have resulted in the Discovery Data Service. They cover the original objectives, the approach to collaboration and shared tenancy, and the information governance rules that underpin the way privacy and sharing are balanced.


*[[What_is_Discovery|What is Discovery]]? - This article describes what Discovery is and how it is conceptualised at a very high level.
These articles provide information about the applications that have been by the technologies
*[[Case studies]] - An overview of some initial projects that access and utilise data from Discovery; information includes the applicant, project summary, and the latest status (Development/Live).
*[[Latest news]] - The latest information for all Discovery Data Service releases and changes, plus known issues and updates from system suppliers and other third parties.
*[[Current_data_sets|Current data sets]] - the broad types of data received from various systems.
*[[Current published data]] - provides the latest data publisher information by sector, geographical area, service, and system provided


= Services and applications =
* [[Information model manager]] - an application designed to provide a view of the common information model, concept sets, value sets and query definitions and support the authoring of the content of the model.
 
These articles provide information about the services and applications provided by the Discovery information services.
 
* [[Discovery Query|Sextant]] - A data set distribution service with an option to post the data directly into the recipients database.
*[[Monitoring and alerting]] - provides an overview of the monitoring and alert systems in place.
*[[Monitoring and alerting]] - provides an overview of the monitoring and alert systems in place.


Line 45: Line 40:


*[[UPRN address match application|ASSIGN- UPRN address matching application -]] a web based application that matches single or batches of hand entered address to authoritative addresses and assigns a unique property reference number.
*[[UPRN address match application|ASSIGN- UPRN address matching application -]] a web based application that matches single or batches of hand entered address to authoritative addresses and assigns a unique property reference number.
*[[Information model manager]] - an application designed to provide a view of the common information model, and support the authoring of the content of the model.
*[[Alert Generator]] - a system that generates a patient alert based on a query, sends a notification to recipients and provides recipients with access to a  web application to view the content of the record according to the data set
*[[Information_model_service|Information model services]] - the technical services that enable the common information model to be used.
*
*[[FHIR Get Structured Record API]] - returns a complete patient record in a structured format following GP and Care Connect standards.
*[[HL7v2 API]] - Send HL7v2 ADT and ORU (clinical events) data to Discovery.
*Get health record - the service that obtains a fully structured health record about a person, in real time via a standards based API.
*Record publication service - the service that publishes data from health records for specific purposes, often immediately on receipt.
*Data set distribution service - the service that distributes sets of data for populations of patients where the definition is complex or where the subscriber is hosting a copy of the data permanently.
*[[NHS 111 Discovery frailty flagging]] / [[Frailty algorithm]]
*[[GitHub repositories]] - descriptions and information relating to the application source code.
 
= Architectures =
These articles provide information about the overall high level software architecture models providing a descriptions and visualisations of the Discovery Data Service and information service components and how they interact.
 
* The [[Data Storage Architecture]] illustrates how data is stored within the service and the various implementation options available for organisations that wish to use some or parts of the services.
*[[Identity Authentication Authorisation|Identity, authentication and authorisation]] specifies the approach taken by Discovery for accessing utilities and controlling some aspects of access to application functionality and some data resources, after all of the other locks have been opened.
*[[Application zone architecture]] illustrates how the data is accessed in different places and in different ways according to different use cases
*[[Pseudonymisation]] describes how Discovery generates pseudonymised data.
*[[Data linking]] describes how Discovery links several patient records into a single person/citizen record.

Revision as of 16:26, 5 May 2022

These articles describe the various technologies underpinning the Endeavour and Discovery open source systems and related operational services which are currently live.

Discovery Data Service and information model

Discovery is based on the hypothesis that; If health related data is brought together at the level of the individual in close to real time, and stored together at the level of a medium size residential population, and made available via a common data model as part of a common ontology, and then subsequently used for individual and population based decision support, great benefits to health can accrue.

Discovery consists of a set of technology components that link near real time data from millions of records from thousands of provider organisations, as well as an information model consisting of a set of ontologies and a common data model. All the technologies that have been developed are open source and available for anyone to use.

Discovery forms the basis of an NHS owned data service called the Discovery data service (we like nautical things) , operating across the city of London, covering 3 ICSs and a residential population of 7.5 million citizens. The service seeks to use data as close as possible to its original entry form as entered by health professionals or the citizen themselves, and to use that data as close to real time as the publishers of that data can make available.

Information model Components

These articles provide information about the software used by Endeavour- Discovery and the information modelling processes that these support.

  • Health Information model - An overview of the approach to the Discovery information model, the purpose, and type of content.
  • Information model language - The Semantic Web languages and domain specific languages used to build the various components of the information models
  • Real data query - The relationship between the various information model artefacts and how actual health and care data in systems would be queried using the models
  • Mapping concepts and transforming published data - Introduces the approaches to matching and mapping concepts and the structural maps used in transforming published data,
  • Architectures - A high level overview of the architectures that the technologies contribute to
  • GitHub repositories - descriptions and information relating to the application source code, .

Services

  • London Discovery data service. Provides information about the London NHS service that are based on these technologies.
  • ASSIGN - UPRN. An address matching application and service that matches addresses held in source systems in various forms, to the addresses made available under license by the Ordnance Survey and Post office, including the assigning of a URPN. The application and service has been jointly developed by the Endeavour Health Charitable trust and Queen Mary's University of London and the Clinical effectiveness Group (CEG)
  • Information model services - the technical services , such as APIs and apps that enable an model instance to be used or to implement an EHR based on the model or particular data model
  • Get Structured Record API - returns a complete patient record in a structured format following GP and Care Connect standards.
  • Sextant - A data set distribution service with an option to post the data directly into the recipients database.
  • Data Distribution services that distribute daily weekly or adhoc small data sets from the Discovery core data stores with examples from 2020

Applications

These articles provide information about the applications that have been by the technologies

  • Information model manager - an application designed to provide a view of the common information model, concept sets, value sets and query definitions and support the authoring of the content of the model.
  • Monitoring and alerting - provides an overview of the monitoring and alert systems in place.
  • Data Sharing manager- DSM provides a visual representation of data that is being shared and processed and by which organisations, regions, and/or services.
  • ASSIGN- UPRN address matching application - a web based application that matches single or batches of hand entered address to authoritative addresses and assigns a unique property reference number.
  • Alert Generator - a system that generates a patient alert based on a query, sends a notification to recipients and provides recipients with access to a web application to view the content of the record according to the data set