Difference between revisions of "Enhanced Imaging Workflow IP"
(46 intermediate revisions by one other user not shown) | |||
Line 2: | Line 2: | ||
==1. Proposed Workitem: Enhanced Imaging Workflow for Anatomic Pathology== | ==1. Proposed Workitem: Enhanced Imaging Workflow for Anatomic Pathology== | ||
− | * Editor: Thomas | + | * Editor: Thomas Schrader |
− | The development of slide scanners offers the possibility to digitize glass slides in Pathology and this is the beginning of a new paradigm in this medical domain. New terms were created: <b>Digital Pathology</b> or <b> | + | The development of slide scanners offers the possibility to digitize glass slides in Pathology and this is the beginning of a new paradigm in this medical domain. New terms were created: <b>Digital Pathology</b> or <b>Collaborative Pathology</b> expressing the new potentials in the diagnostic process.<br> |
Not only digital patient data but also Whole Slide Images (WSI) are available now and can be used for <br> | Not only digital patient data but also Whole Slide Images (WSI) are available now and can be used for <br> | ||
− | + | <ul> | |
− | + | <li> support of diagnostic process</li> | |
− | + | <li> analysis of images</li> | |
− | With digitalization of glass slides two different discussions begun:< | + | <li> further analysis of clinical data.</li> |
− | + | </ul> | |
− | + | With digitalization of glass slides two different discussions begun: | |
− | Meanwhile different scanning technologies are avialable and can be | + | <ol> |
+ | <li> How to integrate the digitalization process into the general diagnostic process in a Pathology Department? </li> | ||
+ | <li> How to integrate efficiently image analysis into the diagnostic process?<br> | ||
+ | Meanwhile different scanning technologies are avialable and can be used to evaluate different diagnostic questions e.g. multispectral images allow an enhancement in image quality and analysis.</li> | ||
+ | </ol> | ||
+ | --[[User:Tschrade|Tschrade]] 03:26, 17 August 2011 (CDT) | ||
==2. The Problem== | ==2. The Problem== | ||
+ | At least two problems exist in integrating digialization and image analysis into the pathology processes:<br> | ||
+ | <ol> | ||
+ | <li> Image analysis can be done at various process steps during the diagnostic process and have different purposes: An explorative image analysis before the microscopic evaluation by the pathologist can extract regio of interests, enhance image quality or count some basic data such as lymph nodes. An analysis step after or during the microscopic evaluation is more specific: regio of interests can be marked very specifically. The results of such analysis can answer questions e.g. about mitosis rate, form factors of tumor cells, expression of tumor markers and much more.</li> | ||
+ | <li>Different scanning technologies can be used to digitize glass slides: bright field scanning, multispectral scanning, immunfluoreszence scanning, high resolution scanning (oil immersion). New scanning technologies will be developed. The application of these technologies depends on various factors and are influenced by specimen, and diagnostic question.</li> | ||
+ | </ol> | ||
+ | Related to image processing the following actors and transactions are described in the Technical Framework[http://www.ihe.net/Technical_Framework/index.cfm#pathology]: | ||
+ | [[File:ActorsTransactions.png|800px|thumb|center|Transactions and Actors in the current TFAP]]<br> | ||
+ | <b>Evidence Creator</b>: A system that creates additional evidence objects such as images, presentation states, Key Image Notes, and/or Evidence Documents and transmits them to an Image Archive. It also makes requests for storage commitment to the Image Manager for the data previously transmitted.<br> | ||
+ | <b>Image Archive</b>: A system that provides long term storage of evidence objects such as images, presentation states, Key Image Notes and Evidence Documents. | ||
+ | <br> | ||
+ | <b>Image Display</b>: A system that offers browsing of patient‘s studies including anatomic pathology image folders. In addition, it may support the retrieval and display of selected evidence objects including sets of images, presentation states and Evidence Documents.<br> | ||
+ | <b>Image Manager</b>: A system that provides functions related to safe storage and management of evidence objects. It supplies availability information for those objects to the Department System Scheduler.<br> | ||
+ | <b>PAT-4 Procedure Scheduled and Updated</b>: The Department System Scheduler/Order Filler sends the Image Manager and Report Manager scheduled procedure information or procedure update.<br> | ||
+ | <b>PAT-5 Query Modality Worklist</b>: Based on a query entered at the Acquisition Modality, a modality worklist is generated listing all the items that satisfy the query. This list of Scheduled Procedure Steps with selected demographic information and information about specimen is returned to the Acquisition Modality.<br> | ||
+ | <b>PAT-6 Modality Procedure Status Notification</b>: After a Modality Worklist Item is selected at the Acquisition Modality for starting an Image Acquisition Proccess over a specimen, the Acquisition Modality notifies the Order Filler to let it update its Modality Worklist removing the started item from it. Upon completion of the Image Acquisition process the Acquisition Modality notifies the Order Filler that a DICOM instance has been stored. Also, if the Image Acquisition aborts the Acquisition Modality notifes this status to the Order Filler.<br> | ||
+ | <b>RAD-8 Modality Images Stored</b>: An Acquisition Modality sends acquired or generated images to the Image Archive. Defined in RAD TF-1:2.4, specified in RAD TF-2:4.8.<br> | ||
+ | <b>RAD-10 Storage Commitment</b>: A requestor (Acquisition Modality or Evidence Creator) requests that the Image Manager confirm ownership for the specified DICOM objects (images, GSPS objects, Key Image Notes, Evidence Documents or any combination thereof) that the requestor stored in the Image Archive, thus allowing the sender to delete those objects now owned by the Image Manager. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.10.<br> | ||
+ | <b>RAD-14 Query Images</b>: An Image Display queries the Image Archive for a list of entries representing images by patient, study, series, or instance. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.14.<br> | ||
+ | <b>RAD-16 Retrieve Images</b>: An Image Display or an Imaging Document Consumer requests and retrieves a particular image or set of images from the Image Archive or an Imaging Document Source, respectively. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.16.<br> | ||
+ | <b>RAD-43 Evidence Document Stored</b>: A source actor of Evidence Documents (Acquisition Modality or Evidence Creator) sends recorded, measured or derived diagnostic evidence in 710 the form of a DICOM Structured Report to the Image Archive. Defined in RAD TF-1:2.4, specified in RAD TF-3:4.43<br> | ||
+ | <h3>What is missing? What is essential for the future?</h3> | ||
+ | A knowledge based interaction between Image Manager, Acquisition Modality and Evidence Create is essential for a controlled and effective scanning and analysis process.<br> | ||
+ | From the order filler patient information including diagnostic question,and patient history as well as case information including type of specimen, block ID, slide ID, staining procedure, kind of tissue are available and can influence the process of image acquistion and processing. | ||
+ | |||
+ | --[[User:Tschrade|TSchrader]] 17:01, 23 August 2011 (CDT) | ||
==3. Key Use Case== | ==3. Key Use Case== | ||
+ | In the following figure the complete process of general pathology is presented. At the moment the digitalization of glass slide is not integrated in the routine processes. <br> | ||
+ | The general diagnostic pathology process: [[File:GeneralPathologyProcess.png|800px|thumb|center|Model of General Pathology Process]]<br> | ||
+ | For cytology a slight different process was modeled: <br> | ||
+ | [[File:Cytology.png|800px|thumb|center|Specialized Process for Cytology]] | ||
+ | The used technology of scanning depends on various factors: | ||
+ | <ul> | ||
+ | <li>Staining method: e.g. regulary staining, fluorescence staining</li> | ||
+ | <li>Kind of specimen: e.g. high resolution (60x, 100x oil immersion) for cytology</li> | ||
+ | <li>Analysis tasks</li> | ||
+ | </ul> | ||
+ | |||
+ | [[File:Digitalization.png|800px|thumb|center|Digitalization and Image Analysis]] | ||
+ | --[[User:Tschrade|TSchrader]] 15:17, 23 August 2011 (CDT) | ||
==4. Standards & Systems== | ==4. Standards & Systems== | ||
+ | Various standards are important for image acquisition and processing: | ||
+ | <ul> | ||
+ | <li>DICOM (of course!)</li> | ||
+ | <li>HL7 (of course!)</li> | ||
+ | </ul> | ||
+ | |||
+ | For knowledge representation the following standards would be important: | ||
+ | <ul> | ||
+ | <li>Web Ontology Language (OWL)</li> | ||
+ | <li>Resource Description Framework (RDF)</li> | ||
+ | <li>Semantic Web Rule Language (SWRL)</li> | ||
+ | </ul> | ||
+ | Standards or Standard Operating Procedures for Image Analysis in Pathology are not available. | ||
+ | |||
+ | --[[User:Tschrade|TSchrader]] 17:55, 23 August 2011 (CDT) | ||
==5. Discussion== | ==5. Discussion== | ||
+ | There is a clear need to integrate knowledge into the image processing in pathology. | ||
+ | |||
+ | <h3>New Actors in Pathology IHE Workflow </h3> | ||
+ | Two different variants are possible: | ||
+ | <ol> | ||
+ | <li>Create a specialed (complete) actor for pathology workflow or</li> | ||
+ | <li>Integrate existing actors from other TF's | ||
+ | </ol> | ||
+ | [[File:ExtendedImageManagement.png|800px|thumb|center|New Actor for intelligent Image Acquistion and Processing]] | ||
+ | <h4>Possible Actor from other TF</h4> | ||
+ | |||
+ | <b>Treatment Management System (TMS)</b> – An information system that manages oncology information and is responsible for the scheduling of radiotherapy activities (i.e. is a workflow manager). The TMS fulfils the role of a UPS-Pull ‘Worklist Manager’ SCP as described in DICOM Supplement 96 Part 17 Table Z.1-1. Note that in this profile the TMS fulfills the role of an Archive for the data objects, in which case the supplied AE Title in Input and Output Sequences is an AE Title managed by the TMS. Note that the TMS actors in other IHE-RO profiles have functionality that is different from that described in this profile. | ||
+ | Technical Framework Supplement | ||
+ | Treatment Delivery Workflow (TDW) | ||
+ | [http://www.ihe.net/Technical_Framework/upload/IHE-RO-TF_Suppl_Treatment_Delivery_Workflow_PC_2010-01-29.pdf] | ||
+ | |||
+ | --[[User:Tschrade|TSchrader]] 18:57, 23 August 2011 (CDT) |
Latest revision as of 04:38, 27 August 2011
1. Proposed Workitem: Enhanced Imaging Workflow for Anatomic Pathology
- Editor: Thomas Schrader
The development of slide scanners offers the possibility to digitize glass slides in Pathology and this is the beginning of a new paradigm in this medical domain. New terms were created: Digital Pathology or Collaborative Pathology expressing the new potentials in the diagnostic process.
Not only digital patient data but also Whole Slide Images (WSI) are available now and can be used for
- support of diagnostic process
- analysis of images
- further analysis of clinical data.
With digitalization of glass slides two different discussions begun:
- How to integrate the digitalization process into the general diagnostic process in a Pathology Department?
- How to integrate efficiently image analysis into the diagnostic process?
Meanwhile different scanning technologies are avialable and can be used to evaluate different diagnostic questions e.g. multispectral images allow an enhancement in image quality and analysis.
--Tschrade 03:26, 17 August 2011 (CDT)
2. The Problem
At least two problems exist in integrating digialization and image analysis into the pathology processes:
- Image analysis can be done at various process steps during the diagnostic process and have different purposes: An explorative image analysis before the microscopic evaluation by the pathologist can extract regio of interests, enhance image quality or count some basic data such as lymph nodes. An analysis step after or during the microscopic evaluation is more specific: regio of interests can be marked very specifically. The results of such analysis can answer questions e.g. about mitosis rate, form factors of tumor cells, expression of tumor markers and much more.
- Different scanning technologies can be used to digitize glass slides: bright field scanning, multispectral scanning, immunfluoreszence scanning, high resolution scanning (oil immersion). New scanning technologies will be developed. The application of these technologies depends on various factors and are influenced by specimen, and diagnostic question.
Related to image processing the following actors and transactions are described in the Technical Framework[1]:
Evidence Creator: A system that creates additional evidence objects such as images, presentation states, Key Image Notes, and/or Evidence Documents and transmits them to an Image Archive. It also makes requests for storage commitment to the Image Manager for the data previously transmitted.
Image Archive: A system that provides long term storage of evidence objects such as images, presentation states, Key Image Notes and Evidence Documents.
Image Display: A system that offers browsing of patient‘s studies including anatomic pathology image folders. In addition, it may support the retrieval and display of selected evidence objects including sets of images, presentation states and Evidence Documents.
Image Manager: A system that provides functions related to safe storage and management of evidence objects. It supplies availability information for those objects to the Department System Scheduler.
PAT-4 Procedure Scheduled and Updated: The Department System Scheduler/Order Filler sends the Image Manager and Report Manager scheduled procedure information or procedure update.
PAT-5 Query Modality Worklist: Based on a query entered at the Acquisition Modality, a modality worklist is generated listing all the items that satisfy the query. This list of Scheduled Procedure Steps with selected demographic information and information about specimen is returned to the Acquisition Modality.
PAT-6 Modality Procedure Status Notification: After a Modality Worklist Item is selected at the Acquisition Modality for starting an Image Acquisition Proccess over a specimen, the Acquisition Modality notifies the Order Filler to let it update its Modality Worklist removing the started item from it. Upon completion of the Image Acquisition process the Acquisition Modality notifies the Order Filler that a DICOM instance has been stored. Also, if the Image Acquisition aborts the Acquisition Modality notifes this status to the Order Filler.
RAD-8 Modality Images Stored: An Acquisition Modality sends acquired or generated images to the Image Archive. Defined in RAD TF-1:2.4, specified in RAD TF-2:4.8.
RAD-10 Storage Commitment: A requestor (Acquisition Modality or Evidence Creator) requests that the Image Manager confirm ownership for the specified DICOM objects (images, GSPS objects, Key Image Notes, Evidence Documents or any combination thereof) that the requestor stored in the Image Archive, thus allowing the sender to delete those objects now owned by the Image Manager. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.10.
RAD-14 Query Images: An Image Display queries the Image Archive for a list of entries representing images by patient, study, series, or instance. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.14.
RAD-16 Retrieve Images: An Image Display or an Imaging Document Consumer requests and retrieves a particular image or set of images from the Image Archive or an Imaging Document Source, respectively. Defined in RAD TF-1:2.4, specified in RAD-TF-2:4.16.
RAD-43 Evidence Document Stored: A source actor of Evidence Documents (Acquisition Modality or Evidence Creator) sends recorded, measured or derived diagnostic evidence in 710 the form of a DICOM Structured Report to the Image Archive. Defined in RAD TF-1:2.4, specified in RAD TF-3:4.43
What is missing? What is essential for the future?
A knowledge based interaction between Image Manager, Acquisition Modality and Evidence Create is essential for a controlled and effective scanning and analysis process.
From the order filler patient information including diagnostic question,and patient history as well as case information including type of specimen, block ID, slide ID, staining procedure, kind of tissue are available and can influence the process of image acquistion and processing.
--TSchrader 17:01, 23 August 2011 (CDT)
3. Key Use Case
In the following figure the complete process of general pathology is presented. At the moment the digitalization of glass slide is not integrated in the routine processes.
The general diagnostic pathology process:
For cytology a slight different process was modeled:
The used technology of scanning depends on various factors:
- Staining method: e.g. regulary staining, fluorescence staining
- Kind of specimen: e.g. high resolution (60x, 100x oil immersion) for cytology
- Analysis tasks
--TSchrader 15:17, 23 August 2011 (CDT)
4. Standards & Systems
Various standards are important for image acquisition and processing:
- DICOM (of course!)
- HL7 (of course!)
For knowledge representation the following standards would be important:
- Web Ontology Language (OWL)
- Resource Description Framework (RDF)
- Semantic Web Rule Language (SWRL)
Standards or Standard Operating Procedures for Image Analysis in Pathology are not available.
--TSchrader 17:55, 23 August 2011 (CDT)
5. Discussion
There is a clear need to integrate knowledge into the image processing in pathology.
New Actors in Pathology IHE Workflow
Two different variants are possible:
- Create a specialed (complete) actor for pathology workflow or
- Integrate existing actors from other TF's
Possible Actor from other TF
Treatment Management System (TMS) – An information system that manages oncology information and is responsible for the scheduling of radiotherapy activities (i.e. is a workflow manager). The TMS fulfils the role of a UPS-Pull ‘Worklist Manager’ SCP as described in DICOM Supplement 96 Part 17 Table Z.1-1. Note that in this profile the TMS fulfills the role of an Archive for the data objects, in which case the supplied AE Title in Input and Output Sequences is an AE Title managed by the TMS. Note that the TMS actors in other IHE-RO profiles have functionality that is different from that described in this profile. Technical Framework Supplement Treatment Delivery Workflow (TDW) [2]
--TSchrader 18:57, 23 August 2011 (CDT)