Difference between revisions of "IHE Test Tool Information"

From IHE Wiki
Jump to: navigation, search
(Index to IHE Test Tools)
(Index to IHE Test Tools)
 
(52 intermediate revisions by 2 users not shown)
Line 11: Line 11:
 
{| style="width:100%" border="1" cellpadding="3"
 
{| style="width:100%" border="1" cellpadding="3"
 
! Tool !! Developed by !! Type !! Tool Location / Installation !! User documentation & Training !! Ready to use? !! Support  !! Used for
 
! Tool !! Developed by !! Type !! Tool Location / Installation !! User documentation & Training !! Ready to use? !! Support  !! Used for
|- style="background-color:lightblue"
 
|  ATNA: Gazelle Security Suite (gss)
 
|  IHE-Europe at Kereval
 
|  web-based
 
|  http://gazelle.ihe.net/gss
 
| [http://gazelle.ihe.net/content/atna-tests ATNA pre-CAT test cases]
 
 
[https://gazelle.ihe.net/gazelle-documentation/Gazelle-Security-Suite/user.html User Guide]
 
|  Yes
 
| submit issues & questions to our [http://gazelle.ihe.net/jira/browse/TLS jira issue tracker]
 
|  '''ITI''':  ATNA (logging, TLS, digital certs)
 
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
|  CDA Validation tool
 
|  CDA Validation tool
Line 69: Line 58:
 
| c'thon testing
 
| c'thon testing
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
|  Gazelle External Validation Services (EVS) aka "EVS client"
+
|  Gazelle External Validation Services (EVS) aka "EVSClient"
 
|  IHE-Europe at Kereval
 
|  IHE-Europe at Kereval
 
|  web-based
 
|  web-based
 
|  [http://gazelle.ihe.net/EVSClient/ External Validation Service Front-End]  
 
|  [http://gazelle.ihe.net/EVSClient/ External Validation Service Front-End]  
 
|  [http://gazelle.ihe.net/content/evs-ihe-external-validation-services Gazelle External Validation Services user guide]
 
|  [http://gazelle.ihe.net/content/evs-ihe-external-validation-services Gazelle External Validation Services user guide]
|  Yes
+
|  Yes, but upd. to FHIR STU3 due Nov/Dec-17
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/EVSCLT Jira issue tracker]
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/EVSCLT Jira issue tracker]
 
|  '''AP''':  APW, ARPH
 
|  '''AP''':  APW, ARPH
Line 159: Line 148:
 
'''LAB''': LTW, LAW
 
'''LAB''': LTW, LAW
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
|  Gazelle Patient Manager - PAM, PIX, PDQ, ADT simulator
+
|  Gazelle PatientManager - PAM, PIX* & PDQ* (HL7v2, v3, FHIR STU3), ADT simulator
 
|  IHE-Europe at Kereval
 
|  IHE-Europe at Kereval
 
|  web-based
 
|  web-based
 
|  [http://gazelle.ihe.net/PatientManager/home.seam Patient Manager application]
 
|  [http://gazelle.ihe.net/PatientManager/home.seam Patient Manager application]
|  [http://gazelle.ihe.net/content/patient-manager-user-manual Patient Manager user guide]
+
|  [https://gazelle.ihe.net/gazelle-documentation/Patient-Manager/user.html user guide]
 
|  Yes
 
|  Yes
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/PAM Jira issue tracker]
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/PAM Jira issue tracker]
|  '''ITI''':  PAM, PDQ, PIX, PDS for XDS
+
|  '''ITI''':  PAM, PDQ*, PIX*, PDS for XDS
  
 
'''RAD, EYE, CARD''':  ADT actor
 
'''RAD, EYE, CARD''':  ADT actor
Line 178: Line 167:
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/PROXY Jira issue tracker]
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/PROXY Jira issue tracker]
 
|  proxy for non-TLS msgs
 
|  proxy for non-TLS msgs
 +
|- style="background-color:lightblue"
 +
|  Gazelle Security Suite (gss)
 +
|  IHE-Europe at Kereval
 +
|  web-based
 +
|  http://gazelle.ihe.net/gss
 +
| [http://gazelle.ihe.net/content/atna-tests ATNA pre-CAT test cases]
 +
 +
[https://gazelle.ihe.net/gazelle-documentation/Gazelle-Security-Suite/user.html User Guide]
 +
|  Yes
 +
| submit issues & questions to our [http://gazelle.ihe.net/jira/browse/TLS jira issue tracker]
 +
| '''ITI''': ATNA
 +
 +
'''RAD''': SOLE
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
|  Gazelle SVS simulator & validator
 
|  Gazelle SVS simulator & validator
Line 213: Line 215:
 
|  
 
|  
 
| '''ITI''': XCPD
 
| '''ITI''': XCPD
 +
|- style="background-color:lightblue"
 +
|  Gazelle XD* (XD Star) Client Application
 +
|  IHE-Europe at Kereval
 +
|  web-based
 +
|  [http://gazelle.ihe.net/XDStarClient/home.seam Gazelle XD* Client Application]
 +
|  [http://gazelle.ihe.net/content/xdstarclient Introduction to XDStarClient]
 +
|  Yes
 +
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/XDSTAR Jira issue tracker]
 +
| '''ITI''': servers in XDS, XDR, XCA, MPQ, DSUB, XCPD, XCF
 +
 +
'''RAD''':  XDS-I, XCA-I
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
|  Gazelle XDW validator
 
|  Gazelle XDW validator
Line 233: Line 246:
 
| submit issues & questions to our [http://gazelle.ihe.net/jira/browse/XUA Jira issue tracker]
 
| submit issues & questions to our [http://gazelle.ihe.net/jira/browse/XUA Jira issue tracker]
 
| '''ITI''': XUA
 
| '''ITI''': XUA
|- style="background-color:lightblue"
 
|  Gazelle XD* (XD Star) Client Application
 
|  IHE-Europe at Kereval
 
|  web-based
 
|  [http://gazelle.ihe.net/XDStarClient/home.seam Gazelle XD* Client Application]
 
|  [http://gazelle.ihe.net/content/xdstarclient Introduction to XDStarClient]
 
|  Yes
 
|  submit issues & questions to our [http://gazelle.ihe.net/jira/browse/XDSTAR Jira issue tracker]
 
| '''ITI''': servers in XDS, XDR, XCA, MPQ, DSUB, XCPD, XCF and '''RAD''':  XDS-I, XCA-I
 
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
|  HL7 v2.x Msg ValidationTool
 
|  HL7 v2.x Msg ValidationTool
Line 313: Line 317:
 
|  NIST
 
|  NIST
 
|  web-based
 
|  web-based
|  [http://pixpdqtests.nist.gov/pixpdqtool/ IHE PIX and PDQ Pre-Connectathon Test Tool]
+
|  [http://hl7v2tools.nist.gov IHE PIX and PDQ Pre-Connectathon Test Tool]
|  [http://pixpdqtests.nist.gov/pixpdqtool/#documentation.htm PIX / PDQ Tool documentation]
+
|  [http://hl7v2tools.nist.gov/portal/#/publications PIX / PDQ Tool documentation]
  
 
Instructions for submitting results are in actor test plans on: [http://ihewiki.wustl.edu/wiki/index.php/Pre-Connectathon/MESA_Software MESA Tools page]
 
Instructions for submitting results are in actor test plans on: [http://ihewiki.wustl.edu/wiki/index.php/Pre-Connectathon/MESA_Software MESA Tools page]
Line 357: Line 361:
 
| '''QRPH:''' VRDR HL7v2
 
| '''QRPH:''' VRDR HL7v2
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
|  XDS Public Registry Server
+
|  XDS Public Registry Server (v4.x.x)
 
|  NIST
 
|  NIST
 
|  web-based
 
|  web-based
Line 366: Line 370:
 
| '''ITI''': XDS.b clients
 
| '''ITI''': XDS.b clients
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
|  XDS toolkit v4.x.x
+
|  XDS toolkit v5.x.x
 
|  NIST
 
|  NIST
 
|  install/run locally
 
|  install/run locally
 
|  [https://github.com/usnistgov/iheos-toolkit2/releases XDS Toolkit download]
 
|  [https://github.com/usnistgov/iheos-toolkit2/releases XDS Toolkit download]
|  [https://github.com/usnistgov/iheos-toolkit2/wiki/Version-4.0.0-Release-Notes Release notes]
+
|  [https://github.com/usnistgov/iheos-toolkit2/releases XDS Toolkits Release notes]
  
 
[https://github.com/usnistgov/iheos-toolkit2/wiki/Toolkit Documentation]
 
[https://github.com/usnistgov/iheos-toolkit2/wiki/Toolkit Documentation]
 
| Yes
 
| Yes
 
|  [http://groups.google.com/group/ihe-xds-implementors XDS implementors google group]
 
|  [http://groups.google.com/group/ihe-xds-implementors XDS implementors google group]
| '''ITI''':  XCA, XDR, XDS.b, MPQ, XDS-I, XCA-I
+
| '''ITI''':  XDS.b, XDR, XCA, MPQ, RMD, MHD
  
 
'''RAD''': XDS-I.b, XCA-I
 
'''RAD''': XDS-I.b, XCA-I
Line 431: Line 435:
 
== Are they a requirement if I am doing Supportive testing? ==  
 
== Are they a requirement if I am doing Supportive testing? ==  
 
Our [http://gazelle.ihe.net/content/supportivethorough-testing policy on Supportive testing] states that if you qualify to perform Supportive testing, pre-Connectathon tests are not a requirement (because you have completed them in a previous year).  Note, however, that we do not remove these tests from your pre-Connectathon list of 'Tests do do'; some vendors still want to perform the tests as part of their preparation.  If you choose to skip the tests, just mark their status to be 'Supportive' in gazelle so we understand your intent.
 
Our [http://gazelle.ihe.net/content/supportivethorough-testing policy on Supportive testing] states that if you qualify to perform Supportive testing, pre-Connectathon tests are not a requirement (because you have completed them in a previous year).  Note, however, that we do not remove these tests from your pre-Connectathon list of 'Tests do do'; some vendors still want to perform the tests as part of their preparation.  If you choose to skip the tests, just mark their status to be 'Supportive' in gazelle so we understand your intent.
 +
 +
=  What if a test reports a problem in my software? =
 +
The IHE tools are intended to test compliance with specifications in the IHE Technical Frameworks.   
 +
 +
When a tool logs an error, it is reporting a difference between a message produced by a vendor application and <i>the tool developer’s interpretation</i> of the requirements in the Technical Framework. 
 +
 +
So, a typical reaction by an implementer to an error reported by a tool is one of:
 +
* “Oh wow, I have a gap in my implementation.  I can now fix it so that my message is compliant with the requirements in the IHE Technical Framework.”
 +
* “The tool reported this error, but I think my implementation is correct.”  In that case, you should report the error. We will make an assessment of the tool vs. the specification and will happily fix the tool as needed.
 +
* “The tool reported an error, but for ‘X’ reason (product-specific, deployment-scenario-specific…), I will not change my implementation to be 100% IHE-compliant for this message."
 +
 +
A given tool rarely, if ever, provides 100% coverage in evaluating an implementation vs. IHE Technical Framework requirements.    For some IHE profiles, there is more than one tool, each providing different coverage. 
 +
 
 +
In the context of a Connectathon, IHE promotes a combination of compliance testing between your implementation and a tool **and** face-to-face interoperabity testing between vendors at IHE Connectathons.  We believe that combination helps implementers both shake out bugs in their implementation and also demonstrate their ability to interoperate with other vendors based on specifications in IHE Profiles.
 +
 +
IHE Technical Project Managers who have overseen testing at NA and EU IHE Connectathons for many years have heard more than once developers describe the built-in “if Connectathon” switch in their software -- the ability to "turn on" certain capabilities to satisfy a tool or Connectathon test.  We cringe every time.  If your software fails a tool-based test or peer-to-peer test, you should do the assessment in the bullet list above.  In [https://groups.google.com/forum/#!topic/ihe-xds-implementors/I0rejbyRgDU this email thread], John Moehrke (ITI Tech Cmte) provides an example in the context of an audit message.
 +
 +
For the purpose of IHE Connectathon testing, we have never “failed” a vendor for its implementation of a IHE profile/actor because of a single error message reported by a tool.
  
 
=Pre-Connectathon Test Status - by Domain=
 
=Pre-Connectathon Test Status - by Domain=
Line 467: Line 489:
 
|  
 
|  
 
| No test tool.  Test defined to exchange pre-Connectathon samples.
 
| No test tool.  Test defined to exchange pre-Connectathon samples.
 +
|- style="background-color:orange"
 +
| CPN - Cardiac Procedure Note
 +
|
 +
|
 
|- style="background-color:orange"
 
|- style="background-color:orange"
 
| CRC - Cath Report Content
 
| CRC - Cath Report Content
Line 517: Line 543:
 
| Use '''MESA Tools'''.  Use '''Gazelle External Validation Service''' for HL7 msg & DICOM object validation.  Use '''Patient Manager''' & '''Order Manager''' for ADT, ORM & MWL simulators.
 
| Use '''MESA Tools'''.  Use '''Gazelle External Validation Service''' for HL7 msg & DICOM object validation.  Use '''Patient Manager''' & '''Order Manager''' for ADT, ORM & MWL simulators.
 
|}
 
|}
 +
 +
==Dental==
  
 
No Technical Project Manager in this domain.
 
No Technical Project Manager in this domain.
Line 562: Line 590:
 
| ATNA - Audit Trail and Node Authentication  
 
| ATNA - Audit Trail and Node Authentication  
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
|'''SN & SA actors''':  for TLS testing use  '''ATNA Gazelle Security Suite''' to obtain Digital Cert for connectathon testing, plus TLS and ATNA logging testing.
+
|'''SN & SA actors''':  for TLS testing use  '''Gazelle Security Suite''' to obtain Digital Cert for connectathon testing, plus TLS and ATNA logging testing.
  
 
No tools for '''Retrieve Audit Msg''' or '''Retrieve Syslog Msg''' options
 
No tools for '''Retrieve Audit Msg''' or '''Retrieve Syslog Msg''' options
Line 572: Line 600:
 
| BPPC - Basic Patient Privacy Consents  
 
| BPPC - Basic Patient Privacy Consents  
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
| '''Content Creators''' use the '''Gazelle External Validation Services (EVS client) - CDA validator'''
+
| '''Content Creators''' use the '''Gazelle External Validation Services (EVSClient) - CDA validator'''
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| CSD - Care Services Discovery
 
| CSD - Care Services Discovery
Line 593: Line 621:
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
 
|  Use  '''Gazelle External Validation Service -- DSUB validator'''  
 
|  Use  '''Gazelle External Validation Service -- DSUB validator'''  
 +
 +
'''Broker''' actor use '''Gazelle XD* Client''' as ITI-52 and ITI-54 simulator
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| EUA - Enterprise User Authentication
 
| EUA - Enterprise User Authentication
Line 600: Line 630:
 
| HPD - Healthcare Provider Directory
 
| HPD - Healthcare Provider Directory
 
| '''TESTS READY'''
 
| '''TESTS READY'''
| '''HPD Directory and Consumer''' actors use '''HPD Provider Directory test tool''' -- includes base HPD tests & test for the '''Federation Option'''. 
+
| Use the '''Gazelle HPD Simulator (and validator)''' to test ITI-58 and ITI-59
 
+
'''All actors''' use the '''Gazelle External Validation Services - HPD msg validator'''
+
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| IUA - Internet User Authentication
 
| IUA - Internet User Authentication
Line 610: Line 638:
 
| mACM - Mobile Alert Communication Management
 
| mACM - Mobile Alert Communication Management
 
| '''TEST READY'''
 
| '''TEST READY'''
| Actors that create FHIR resources use Gazelle EVSClient
+
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 +
|- style="background-color:lightyellow"
 +
| mCSD - Mobile Care Services Discovery
 +
| '''TEST READY'''
 +
| No test tools; one pre-Connectathon test for '''mCSD''' to load mCSD test data (FHIR Resources) developed for Connectathon testing.
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| MHD - Mobile Access to Health Documents
 
| MHD - Mobile Access to Health Documents
 
| '''TEST READY'''
 
| '''TEST READY'''
| Actors that create FHIR resources use Gazelle EVSClient
+
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 +
 
 +
<i>Tool under development</i>:  MHD testing support in the NIST '''XDS Tools Release 5.x.x''' - expected Nov/Dec 2017
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| MPQ - Multi-Patient Queries
 
| MPQ - Multi-Patient Queries
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
 
| Use the NIST '''XDS Tools'''
 
| Use the NIST '''XDS Tools'''
 +
 +
Use '''Gazelle XD* Client''' simulator to send ITI-55.
 +
 +
|- style="background-color:lightyellow"
 +
| mXDE - Mobile Cross-Enterprise Document Data Element Extraction
 +
| '''TESTS READY'''
 +
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 +
|- style="background-color:lightyellow"
 +
| NPFSm - Non-Patient File Sharing
 +
| '''TESTS READY'''
 +
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PAM - Patient Administration Management
 
| PAM - Patient Administration Management
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
| Use '''Gazelle External Validation Services''' for HL7 msg validation.  
+
| Use '''Gazelle External Validation Services (EVSClient)''' for HL7 msg validation.  
  
 
Use the '''Gazelle Patient Manager''' as a simulator for PAM Patient Demographics Supplier and Consumer.
 
Use the '''Gazelle Patient Manager''' as a simulator for PAM Patient Demographics Supplier and Consumer.
Line 630: Line 675:
 
| Use NIST '''PIX / PDQ tool'''.   
 
| Use NIST '''PIX / PDQ tool'''.   
  
Use '''Gazelle External Validation Services''' for HL7v2 msg validation.   
+
Use '''Gazelle External Validation Services (EVSClient)''' for HL7v2 msg validation.   
  
Use the '''Gazelle Patient Manager''' as a simulator for Patient Demographics Consumer and Supplier.
+
Also use the '''Gazelle PatientManager''' as a simulator for PDQ Consumer or Supplier.
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PDQ-V3 - Patient Demographic Query HL7 v3
 
| PDQ-V3 - Patient Demographic Query HL7 v3
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
| Use NIST '''PIX / PDQ tool'''.   
+
| Use NIST '''PIX / PDQ tool'''.  Also use the '''Gazelle PatientManager''' as a simulator for PDQv3 Consumer or Supplier.
  
Use '''Gazelle External Validation Services''' for HL7v3 msg validation.  
+
Use '''Gazelle External Validation Services (EVSClient''' for HL7v3 msg validation.  
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PDQm - Patient Demographic Query for Mobile
 
| PDQm - Patient Demographic Query for Mobile
 
| '''TEST READY'''
 
| '''TEST READY'''
| Actors that create FHIR resources use Gazelle EVSClient
+
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 +
 
 +
Also use the '''Gazelle PatientManager''' as a simulator for PDQm Consumer or Supplier.
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PIX - Patient Identifier Cross-Referencing
 
| PIX - Patient Identifier Cross-Referencing
Line 648: Line 695:
 
| Use NIST '''PIX / PDQ tool'''.   
 
| Use NIST '''PIX / PDQ tool'''.   
  
Use '''Gazelle External Validation Services''' for HL7v2 msg validation.   
+
Use '''Gazelle External Validation Services (EVSClient)''' for HL7v2 msg validation.   
  
 
Use the '''Gazelle Patient Manager''' as a simulator for PIX Manager, Consumer, and Source actors.
 
Use the '''Gazelle Patient Manager''' as a simulator for PIX Manager, Consumer, and Source actors.
Line 656: Line 703:
 
| Use NIST '''PIX / PDQ tool'''.   
 
| Use NIST '''PIX / PDQ tool'''.   
  
Use '''Gazelle External Validation Services''' for HL7v3 msg validation.  
+
Use '''Gazelle EVSClient''' for HL7v3 msg validation.  
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PIXm - Patient Identifier Cross-Reference for Mobile
 
| PIXm - Patient Identifier Cross-Reference for Mobile
 
| '''TEST READY'''
 
| '''TEST READY'''
| Actors that create FHIR resources use Gazelle EVSClient
+
| Actors that create or consumer FHIR Resources use '''Gazelle External Validation Services (EVSClient)'''
 +
 
 +
Also use the '''Gazelle PatientManager''' as a simulator for PIXm Consumer or PIXm Manager.
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| PLT - Patient Location Tracking
 
| PLT - Patient Location Tracking
Line 681: Line 730:
 
| '''TESTS READY'''   
 
| '''TESTS READY'''   
 
| Use the '''MESA Tools'''
 
| Use the '''MESA Tools'''
 +
|- style="background-color:lightyellow"
 +
| RMD - Remove Metadata and Documents
 +
|
 +
| <i>Tool under development</i>:  MHD testing support in the NIST '''XDS Tools Release 5.x.x''' - expected Nov/Dec 2017
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| SeR - Secure Retrieve
 
| SeR - Secure Retrieve
 
| '''TESTS READY'''   
 
| '''TESTS READY'''   
| Use the '''Gazelle External Validation Services (EVS client) - Assertion validators'''
+
| Use the '''Gazelle External Validation Services (EVSClient) - Assertion validators'''
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| SVS - Sharing Value Sets
 
| SVS - Sharing Value Sets
Line 690: Line 743:
 
| Use the '''Gazelle SVS Simulator'''.   
 
| Use the '''Gazelle SVS Simulator'''.   
  
Also use the '''Gazelle External Validation Service''' for validation of the SVS messages.
+
Also use the '''Gazelle External Validation Service (EVSClient)''' for validation of the SVS messages.
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XCA - Cross-Community Access
 
| XCA - Cross-Community Access
Line 703: Line 756:
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
 
| Use the '''Gazelle XD* Client''' XCF simulator for sending XCF ITI-63 messages
 
| Use the '''Gazelle XD* Client''' XCF simulator for sending XCF ITI-63 messages
Use the '''Gazelle EVS Client''' for ITI-63 request/response msg validation
+
 
 +
Use the '''Gazelle External Validation Services (EVSClient)''' for ITI-63 request/response msg validation
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XCPD - Cross-Community Patient Discovery
 
| XCPD - Cross-Community Patient Discovery
Line 717: Line 771:
 
| XDR - Cross-Enterprise Document Reliable Interchange
 
| XDR - Cross-Enterprise Document Reliable Interchange
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
| '''Doc Recipient''' use the NIST '''XDS Toolkit v4.x.x''''''Doc Source''' use '''XDS Public Registry'''
+
| '''Doc Recipient''' use the '''NIST XDS Toolkit v4.x.x''' (or later release)
Use '''Gazelle EVS Client''' for request/response message validation
+
 
 +
'''Doc Source''' use '''XDS Public Registry'''
 +
 
 +
Use '''Gazelle External Validation Services (EVSClient)''' for request/response message validation
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XDS.b - Cross-Enterprise Document Sharing  
 
| XDS.b - Cross-Enterprise Document Sharing  
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
| '''Doc Registry & Repository''' use the NIST '''XDS Toolkit v4.x.x''' '''Doc Source, Consumer, Administrator''' use '''XDS Public Registry'''
+
| '''Doc Registry & Repository''' use the '''NIST XDS Toolkit v4.x.x''' (or later release
Use '''Gazelle EVS Client''' for request/response message validation
+
 
 +
Use '''Gazelle External Validation Services (EVSClient)''' for request/response message validation
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XDS-SD - Cross-Enterprise Sharing of Scanned Documents
 
| XDS-SD - Cross-Enterprise Sharing of Scanned Documents
 
|  '''TESTS READY'''  
 
|  '''TESTS READY'''  
| '''Content Creators''' use  CDA Schematron and PDF/A validation available in the '''Gazelle External Validation Service'''
+
| '''Content Creators''' use  '''Gazelle External Validation Service (EVSClient)''' -- CDA Schematron and PDF/A validation
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XDW - Cross-Enterprise Document Workflow
 
| XDW - Cross-Enterprise Document Workflow
 
| '''TESTS READY'''   
 
| '''TESTS READY'''   
| '''Content Creators''' use  '''Gazelle External Validation Service -- XDW validator'''  
+
| '''Content Creators''' use  '''Gazelle External Validation Service (EVSClient) -- XDW validator'''  
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XPID - XAD-PID Change Management
 
| XPID - XAD-PID Change Management
 
|  
 
|  
| No test tools.
+
| <i>Tool under development</i>:  XPID testing support in the NIST '''XDS Tools Release 5.x.x''' - expected Nov/Dec 2017
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
 
| XUA - Cross-Enterprise User Assertion  
 
| XUA - Cross-Enterprise User Assertion  
 
| '''TESTS READY'''   
 
| '''TESTS READY'''   
| X-Service Users, use '''Gazelle External Validation Service - Assertion validator'''
+
| X-Service Users, use '''Gazelle External Validation Service (EVSClient) - Assertion validator'''
 
Also use ''' XUA Security Token Service (STS)'''
 
Also use ''' XUA Security Token Service (STS)'''
 
|- style="background-color:lightyellow"
 
|- style="background-color:lightyellow"
Line 1,098: Line 1,156:
 
| CDS-OAT - Clinical Decision Support - Order Appropriateness Tracking
 
| CDS-OAT - Clinical Decision Support - Order Appropriateness Tracking
 
| '''TESTS READY'''
 
| '''TESTS READY'''
| No CDS-OAT-specific tools.  '''Order Placer''' and '''Order Filler''' use Gazelle EVSclient to evaluate base requirements for RAD-2, 3, 4
+
| No CDS-OAT-specific tools.  '''Order Placer''' and '''Order Filler''' use '''Gazelle External Validation Service (EVSClient)''' to evaluate base requirements for RAD-2, 3, 4
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
| CHG - Charge Posting
 
| CHG - Charge Posting
Line 1,147: Line 1,205:
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
 
| '''MESA Tools'''
 
| '''MESA Tools'''
 +
|- style="background-color:lightblue"
 +
| MAP - Management of Acquisitoin Protocols
 +
|
 +
| No test tools.
 +
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
| MAWF - Mammography Acquisition Workflow
 
| MAWF - Mammography Acquisition Workflow
Line 1,185: Line 1,248:
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
| REM - Radiation Exposure Monitoring
 
| REM - Radiation Exposure Monitoring
 +
| '''TESTS READY'''
 +
| '''MOD''' actor use '''REM PixelMed DoseUtility'''
 +
|- style="background-color:lightblue"
 +
| REM-NM - Radiation Exposure Monitoring for Nuclear Medican
 
| '''TESTS READY'''  
 
| '''TESTS READY'''  
 
| '''MOD''' actor use '''REM PixelMed DoseUtility'''
 
| '''MOD''' actor use '''REM PixelMed DoseUtility'''
Line 1,199: Line 1,266:
 
|  
 
|  
 
| No test tool specific to SMI.  Tests defined for '''MOD''', '''Img Display''' & '''Img Mgr''' to exchange pre-connectathon samples & validate DICOM objects.
 
| No test tool specific to SMI.  Tests defined for '''MOD''', '''Img Display''' & '''Img Mgr''' to exchange pre-connectathon samples & validate DICOM objects.
 +
|- style="background-color:lightblue"
 +
| SOLE - Standardized Operational Log of Events
 +
|  '''TESTS READY'''
 +
| Use '''Gazelle Security Suite''' to validate log event contents and send them to the Syslog Collector
 
|- style="background-color:lightblue"
 
|- style="background-color:lightblue"
 
| SWF - Scheduled Workflow
 
| SWF - Scheduled Workflow
Line 1,248: Line 1,319:
 
| XDS-I.b - Cross-enterprise Document Sharing for Imaging
 
| XDS-I.b - Cross-enterprise Document Sharing for Imaging
 
| '''TESTS READY'''
 
| '''TESTS READY'''
| '''Img Doc Source''' use '''XDS Toolkit v4.x.x'''
+
| '''Img Doc Source''' use '''XDS Toolkit v4.x.x''' (or later release)
  
 
Also, use the '''Gazelle XD* client''' for sending RAD-68, -69, -55 messages, and the '''Gazelle External Validation Service - WADO validator'''
 
Also, use the '''Gazelle XD* client''' for sending RAD-68, -69, -55 messages, and the '''Gazelle External Validation Service - WADO validator'''
 
|}
 
|}

Latest revision as of 20:28, 12 December 2017

Overview

This page contains information about test tools available for testing IHE Profiles. Several organization contribute to this set of tools; thus the tools currently reside in different locations and have a variety of support models (jira, email lists). Not all IHE profiles have test tools. This can be a challenge for new implementers, but it is the current state of affairs.

These tools are commonly used in the context of an IHE Connectathon. In that case, our test management tool called 'Gazelle' gives you a customized list of tests to do based on the IHE profiles you support. The tools referenced on this page can be used outside of a Connectathon, but the information on this page assumes that Gazelle is helping to manage testing.

Index to IHE Test Tools

This table lists the tools available for testing IHE profiles, along with links to the tool & documentation.
To determine which tool to use for the profile you want to test, please refer to the domain-specific Index to Pre-Connectathon Tests in the next section.

Tool Developed by Type Tool Location / Installation User documentation & Training Ready to use? Support Used for
CDA Validation tool NIST web-based or download CDA Validation Tool CDA Tool home page Yes CDA Validator contact PCC: all CDA-based profiles except APE, TRS, ETS, ITS
DICOMscope CPI Visualization tools OFFIS install/run locally IHE Display Consistency distribution page DICOMscope overview page Yes RAD: CPI
DVTk DICOM validator Philips, ICT access via External Validation Service Front-End, IHE-->DICOM DVTk training & documentation Yes DVTk forum various DICOM-based profiles
Gazelle CDA Generator IHE-Europe at Kereval web-based CDA Generator CDA Generator info page Yes
Gazelle Demographic Data Server (DDS) IHE-Europe at Kereval web-based Demographic Data Server, or on your connectathon's gazelle under menu Connectathon / Patient Generation & Sharing DDS info page also, Patient Generation & Sharing training slides Yes submit issues & questions to our Jira issue tracker c'thon testing
Gazelle External Validation Services (EVS) aka "EVSClient" IHE-Europe at Kereval web-based External Validation Service Front-End Gazelle External Validation Services user guide Yes, but upd. to FHIR STU3 due Nov/Dec-17 submit issues & questions to our Jira issue tracker AP: APW, ARPH

CARD: CATH, ECHO, REWF, STRESS, CRC, RCS-C

ITI: many; see here

LAB: LAW, LBL, LCSD, LDA, LPOCT, LTW

PCC: XBeR, XTHM

PHARM: DIS, HMW, PADV, PRE, CMPD-WD

QRPH: ADX

RAD: XDS-I.b (Wado)

Gazelle DSUB validator IHE-Europe at Kereval web-based access via External Validation Service Front-End, IHE-->DSUB DSUB validator info page Yes ITI: DSUB
Gazelle HPD validator & simulator IHE-Europe at Kereval web-based access via External Validation Service Front-End, IHE-->Healthcare Provider Directory

HPD Simulator

HPD simulator info page Yes submit issues & questions to our Jira issue tracker ITI: HPD
Gazelle HL7 validator IHE-Europe at Kereval web-based Gazelle HL7 validator HL7 validator info Yes submit issues & questions to our Jira issue tracker many
Gazelle HMW simulator IHE-Europe at Kereval web-based HMW Simulator HMW simulator user guide Yes submit issues & questions to our Jira issue tracker PHARM: HMW
Gazelle LBL simulator IHE-Europe at Kereval web-based LBL simulator LBL simulator user guide Yes submit issues & questions to our Jira issue tracker LAB: LBL
Gazelle LCSD simulator IHE-Europe at Kereval web-based LCSD Simulator LCSD simulator user guide Yes submit issues & questions to our Jira issue tracker LAB: LCSD
Gazelle Order Manager simulator IHE-Europe at Kereval web-based Order Manager application Order Manager user guide Yes submit issues & questions to our Jira issue tracker RAD, EYE, CARD: HL7 orders & DICOM MWL

LAB: LTW, LAW

Gazelle PatientManager - PAM, PIX* & PDQ* (HL7v2, v3, FHIR STU3), ADT simulator IHE-Europe at Kereval web-based Patient Manager application user guide Yes submit issues & questions to our Jira issue tracker ITI: PAM, PDQ*, PIX*, PDS for XDS

RAD, EYE, CARD: ADT actor

Gazelle Proxy IHE-Europe at Kereval web-based Gazelle proxy Proxy user guide Yes submit issues & questions to our Jira issue tracker proxy for non-TLS msgs
Gazelle Security Suite (gss) IHE-Europe at Kereval web-based http://gazelle.ihe.net/gss ATNA pre-CAT test cases

User Guide

Yes submit issues & questions to our jira issue tracker ITI: ATNA

RAD: SOLE

Gazelle SVS simulator & validator IHE-Europe at Kereval web-based Gazelle Sharing Value Set Simulator

access SVS msg validator via External Validation Service Front End, IHE--Sharing Value Sets

SVS Simulator user guide

Value sets provided by the SVS Simulator

Yes submit issues & questions to our Jira issue tracker ITI: SVS
Gazelle WADO validator IHE-Europe at Kereval web-based access via External Validation Service Front-End, IHE-->Wado WADO validator info page Yes RAD: XDS-I.b
Gazelle XCPD simulator & validator IHE-Europe at Kereval web-based access XCPD msg validator via External Validation Service Front-End, IHE-->HL7v3

also, XCPD Responding Gateway Simulator

XCPD validator info page

XCPD Resp GW user manual

Yes ITI: XCPD
Gazelle XD* (XD Star) Client Application IHE-Europe at Kereval web-based Gazelle XD* Client Application Introduction to XDStarClient Yes submit issues & questions to our Jira issue tracker ITI: servers in XDS, XDR, XCA, MPQ, DSUB, XCPD, XCF

RAD: XDS-I, XCA-I

Gazelle XDW validator IHE-Europe at Kereval web-based access via External Validation Service Front-End, IHE-->XDW XDW validation service info page Yes ITI: XDW

PCC: XBer-WD,XTHM-WD

Gazelle XUA assertion validator IHE-Europe at Kereval web-based access via External Validation Service Front-End, IHE-->Assertions Assertion validator info page Yes submit issues & questions to our Jira issue tracker ITI: XUA
HL7 v2.x Msg ValidationTool NIST NIST HL7v2.x Msg Validation Tool Documentation Yes Contact us QRPH: VRDR (2015), HW (2015)
MESA Tools MIR install/run locally MESA Release page Actor test plans Yes MESA tools support email list CARD: CATH, ECHO, REWF, STRESS

EYE: A-EYE, B-EYE, EC-CHG

RAD: ARI, CHG, FUS, KIN, MAMMO, NMI, PGP, PIR, REM, RWF, SINR, SWF, TCE

MRRT tool MIR install/run locally IHE Test and Management Tools IHE Test and Management Tools Yes RAD: MRRT
MRRT Template Validator RSNA Informatics Reporting install/run locally MRRT Template Validator MRRT Templates Yes RAD: MRRT
PCD Isolated testing NIST web-based IHE-PCD Pre-Connectathon Test Tool IHE-PCD Pre-Connectathon tool home page and Tutorial (November 2013) on Cycle 8 tooling/usage Yes NIST support team and join PCD testing google group PCD: all profiles
PCD Instance testing NIST web-based IHE-PCD Connectathon Test Tool IHE-PCD Connectathon tool home page and Tutorial (November 2013) on Cycle 8 tooling/usage Yes NIST support team and join PCD testing google group PCD: all profiles
PDI test application Northwestern install/run locally Northwestern Radiology downloads page Yes Mongkolwat Pattanasak, Ph.D RAD: PDI
PIX / PDQ tool NIST web-based IHE PIX and PDQ Pre-Connectathon Test Tool PIX / PDQ Tool documentation

Instructions for submitting results are in actor test plans on: MESA Tools page

Yes IHE PIX/PDQ google group ITI: PDQ, PDQv3, PIX, PIXv3
REM DoseUtility tool PixelMed web-based or install locally access via External Validation Service Front-End, IHE-->DICOM how to use DoseUtility Yes RAD: REM
RFD Testing System MIR web-based or install locally IHE Test and Management Tools IHE Test and Management Tools Yes QRPH: BFDR-E, VRDR
RO Test Tool 2007 DVTk download access via DVTk download page Yes IHE-RO
Vital Records Tool NIST web-based access via NIST VR Validation Tool VR Tool Presentation Yes website admin QRPH: VRDR HL7v2
XDS Public Registry Server (v4.x.x) NIST web-based access via http://ihexds.nist.gov/ Yes XDS implementors google group ITI: XDS.b clients
XDS toolkit v5.x.x NIST install/run locally XDS Toolkit download XDS Toolkits Release notes

Documentation

Yes XDS implementors google group ITI: XDS.b, XDR, XCA, MPQ, RMD, MHD

RAD: XDS-I.b, XCA-I

XUA Security Token Service (STS) Kereval web-based STS info page service URL Yes ITI: XUA



Tool training material

We gather "how to" information about individual IHE tools, see: http://gazelle.ihe.net/training#ToolTraining

To learn how to use gazelle to find your pre-Connectathon tests and upload results, see: http://gazelle.ihe.net/content/pre-connectathon-testing

How to find your Pre-Connectathon Test Requirements, Tools and Documentation

Each system participating in an IHE Connectathon is required to run a set of pre-Connectathon tests based on the actors/profiles you registered for. First find out which tests are required for your system, then download the tools and documentation you need. Here's how...

  1. What is the general pre-Connectathon test process?
    1. You will locate the tools and documentation you need using the tables below. Some tools you will run locally in your lab; other tools you will access over the internet.
    2. You will complete all tests from your required list of "test to do" in Gazelle. Each test contains a link to the test description containing instructions.
    3. For most pre-Connectathon tests, you will exchange a message (defined in an IHE transaction) with a test tool. Some tests ask you to test an object (eg. CDA document, DICOM image) against a tool that evaluates its contents. The tool will evaluate the message or object and create a log file indicating 0 or more errors.
    4. Once you achieve an error-free log for each test, upload that log file into Gazelle.
    5. Connectathon Project Managers will be monitoring your progress completing tests in the weeks prior to the Connectathon.
  2. Specifically, what are my pre-Connectathon test requirements??? - Pre-Connectathon Test Requirements are available in Gazelle after the close of Connectathon registration.
    1. Requirements for your connectathon test system are in Gazelle under menu Connectathon-->Pre-Connectathon Testing This list of tests to do is based on the profile/actors/options you have registered to test. This is also where you upload results/logs for pre-connectathon tests.
  3. How do I find the test tool software and documentation I need???
    1. The answer to this question has two parts:
      1. Refer to the Index to Pre-Connectathon Test Status by Domain on this page. This will tell you which tools you need based on the profiles you are testing
      2. Next, refer to the Index to IHE Tools below, which contains the location of the software & documentation for each tool
    2. Note that, unlike Connectathon tests, the pre-Connectathon test descriptions do not reside in gazelle itself. This is because IHE has several different organizations that contribute tools and tests. Each pre-Connectathon test in gazelle does contain a link to the external test descriptions.
  4. Where do I upload the results (test logs) from my pre-Connectathon tests In gazelle under Connectathon-->Pre-Connectathon Testing . We have training material on this gazelle task here
  5. When are my test logs due? - Refer to the schedule for your Connectathon. Each event has its own due date.


Are these tests a requirement?

Occasionally we get questions like, "Do I have to complete pre-Connectathon tests in order to participate in the Connectathon?", or "What happens if I don't do my tests?"

In the early years of IHE, the Connectathon sponsors told vendors that if they did not complete their pre-Connectathon tests, they were not allowed to participate in the Connectathon itself. Over time, this hard-and-fast rule has been relaxed a bit to ensure that all interested vendors have the opportunity to perform Connectathon testing.

Here is the guidance we give now:

  • IHE invests in tool development and gives you a set of pre-Connectathon tests because we believe that when you perform these tests, you will improve the implementation of IHE profiles in your product. The tools help your development efforts reach at least one point of confirmation.
  • At the Connectathon, the focus shifts from tool-based tests done during the pre-Connectathon phase to peer-to-peer interoperability tests. That said, IHE's tools are used to check messages & validate content during the Connectathon. If you have completed your pre-Connectathon tests, you will have no problems using the tools during Connectathon week.
  • If you have "done your homework" by completing your pre-Connectathon tests, you will be ***much*** more likely to pass your peer-to-peer tests during the Connectathon. Connectathon Managers review your pre-Connectathon test logs in advance of the event. We know which vendors are prepared and which are not. Unprepared vendors who are struggling during the Connectathon will get low priority support from both the Connectathon Managers and the monitors grading tests. The Connectathon is a fast-paced, rigorous engineering event; if you are not prepared, your test partners will quickly learn that you are not a reliable partner and turn their attention to testing with a vendor who is prepared.

We hope that you are motivated to do your very best to prepare for the Connectathon by completing all of your pre-Connectathon tests by the posted deadline, but completing tests late is better than not doing them at all.

Are they a requirement if I am doing Supportive testing?

Our policy on Supportive testing states that if you qualify to perform Supportive testing, pre-Connectathon tests are not a requirement (because you have completed them in a previous year). Note, however, that we do not remove these tests from your pre-Connectathon list of 'Tests do do'; some vendors still want to perform the tests as part of their preparation. If you choose to skip the tests, just mark their status to be 'Supportive' in gazelle so we understand your intent.

What if a test reports a problem in my software?

The IHE tools are intended to test compliance with specifications in the IHE Technical Frameworks.

When a tool logs an error, it is reporting a difference between a message produced by a vendor application and the tool developer’s interpretation of the requirements in the Technical Framework.

So, a typical reaction by an implementer to an error reported by a tool is one of:

  • “Oh wow, I have a gap in my implementation. I can now fix it so that my message is compliant with the requirements in the IHE Technical Framework.”
  • “The tool reported this error, but I think my implementation is correct.” In that case, you should report the error. We will make an assessment of the tool vs. the specification and will happily fix the tool as needed.
  • “The tool reported an error, but for ‘X’ reason (product-specific, deployment-scenario-specific…), I will not change my implementation to be 100% IHE-compliant for this message."

A given tool rarely, if ever, provides 100% coverage in evaluating an implementation vs. IHE Technical Framework requirements. For some IHE profiles, there is more than one tool, each providing different coverage.

In the context of a Connectathon, IHE promotes a combination of compliance testing between your implementation and a tool **and** face-to-face interoperabity testing between vendors at IHE Connectathons. We believe that combination helps implementers both shake out bugs in their implementation and also demonstrate their ability to interoperate with other vendors based on specifications in IHE Profiles.

IHE Technical Project Managers who have overseen testing at NA and EU IHE Connectathons for many years have heard more than once developers describe the built-in “if Connectathon” switch in their software -- the ability to "turn on" certain capabilities to satisfy a tool or Connectathon test. We cringe every time. If your software fails a tool-based test or peer-to-peer test, you should do the assessment in the bullet list above. In this email thread, John Moehrke (ITI Tech Cmte) provides an example in the context of an audit message.

For the purpose of IHE Connectathon testing, we have never “failed” a vendor for its implementation of a IHE profile/actor because of a single error message reported by a tool.

Pre-Connectathon Test Status - by Domain

The tables below identify the status of pre-Connectathon tests and which tools are used to test each IHE profile.
To locate the tools and documentation, refer to the Index to IHE tools in the previous section.

Anatomic Pathology

Eric Poiseau is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
APW - Anatomic Pathology Workflow No tests defined You may use the Gazelle External Validation Service for HL7 messages specific to this profile
ARPH - Anatomic Pathology Reporting to Public Health No tests defined You may use the Gazelle External Validation Service for HL7 messages specific to this profile
ARSR - Anatomic Pathology Structured Reports

Cardiology

There is no Technical Project Manager assigned to the Cardiology domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
CATH - Cardiac Catheterization Workflow TESTS READY Use MESA Tools. Use Gazelle External Validation Service for HL7 msg & DICOM object validation. Use Patient Manager & Order Manager for ADT, ORM & MWL simulators.
CIRC - Cardiac Imaging Report Content No test tool. Test defined to exchange pre-Connectathon samples.
CPN - Cardiac Procedure Note
CRC - Cath Report Content TESTS READY Use Gazelle External Validation Service for validation of the CDA document
DRPT - Displayable Reports No test tools.
ECHO - Echocardiography Workflow TESTS READY Use MESA Tools. Use Gazelle External Validation Service for HL7 msg & DICOM object validation. Use Patient Manager & Order Manager for ADT, ORM & MWL simulators.
ECG - Retrieve ECG for Display TESTS READY Use MESA Tools
ED-CARD - Evidence Documents for Cardiology TESTS READY Use MESA Tools
ED-CARD extensions for Stress Testing and CT/MR Angiography No test tool. Test defined to exchange pre-Connectathon samples.
EPRC-IE - Electrophysiology Implan/Explant Report Content No test tool. Test defined to exchange pre-Connectathon samples.
IEO - Image-Enabled Office No tests defined No test tools.
RCS-C - Registry Content Submission - Cath PCI TESTS READY Use Gazelle External Validation Service for validation of the CDA document
RCS-EP - Registry Content Submission - Electrophysiology Use Gazelle External Validation Service for validation of the CDA document
REWF - Resting ECG Workflow Some tests ready Use MESA Tools. Use Gazelle External Validation Service for HL7 msg & DICOM object validation. Use Patient Manager & Order Manager for ADT, ORM & MWL simulators. / Note that these are standard "SWF-style" tests. No REWF-specific tests provided.
STRESS - Stress Testing Workflow TESTS READY Use MESA Tools. Use Gazelle External Validation Service for HL7 msg & DICOM object validation. Use Patient Manager & Order Manager for ADT, ORM & MWL simulators.

Dental

No Technical Project Manager in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
SEDI - Secure Exchange of Dental Information

Eye Care

Lynn Felhofer is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
ECED - Eye Care Evidence Documents TESTS READY Use MESA Tools. Evidence Creators also use Gazelle External Validation Service for DICOM object validation.
ECDR - Eye Care Displayable Reports TESTS READY Use MESA Tools
EC-Summary - Eye Care Summary document No test tools. We have a pre-Connectathon test for Content Creator & Content Consumer actors to exchange pre-connectathon sample documents.
GEE - General Eye Evaluation No test tools. We have a pre-Connectathon test for Content Creator & Content Consumer actors to exchange pre-connectathon sample documents.
U-EYECARE - Unified Eye Care Workflow TESTS READY MOD & AMI actors use the Gazelle External Validation Service for DICOM object validation. Use Gazelle Order Manager as a Modality Worklist SCP.

No tools for the new EYECARE HL7 transactions, but pre-Connectathon tests do manual scrutiny of sample messages.

IT Infrastructure

Lynn Felhofer is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
ATNA - Audit Trail and Node Authentication TESTS READY SN & SA actors: for TLS testing use Gazelle Security Suite to obtain Digital Cert for connectathon testing, plus TLS and ATNA logging testing.

No tools for Retrieve Audit Msg or Retrieve Syslog Msg options

APPC - Patient Patient Privacy Consents No test tools;
BPPC - Basic Patient Privacy Consents TESTS READY Content Creators use the Gazelle External Validation Services (EVSClient) - CDA validator
CSD - Care Services Discovery No test tools; one pre-Connectathon test for Directory to load CSD test data developed for Connectathon testing.
CT - Consistent Time No test tools.
DEN - Document Encryption No test tools.
DSG - Document Digital Signature No test tools.
DSUB - Document Metadata Subscription TESTS READY Use Gazelle External Validation Service -- DSUB validator

Broker actor use Gazelle XD* Client as ITI-52 and ITI-54 simulator

EUA - Enterprise User Authentication No test tools.
HPD - Healthcare Provider Directory TESTS READY Use the Gazelle HPD Simulator (and validator) to test ITI-58 and ITI-59
IUA - Internet User Authentication No test tools.
mACM - Mobile Alert Communication Management TEST READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)
mCSD - Mobile Care Services Discovery TEST READY No test tools; one pre-Connectathon test for mCSD to load mCSD test data (FHIR Resources) developed for Connectathon testing.
MHD - Mobile Access to Health Documents TEST READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)

Tool under development: MHD testing support in the NIST XDS Tools Release 5.x.x - expected Nov/Dec 2017

MPQ - Multi-Patient Queries TESTS READY Use the NIST XDS Tools

Use Gazelle XD* Client simulator to send ITI-55.

mXDE - Mobile Cross-Enterprise Document Data Element Extraction TESTS READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)
NPFSm - Non-Patient File Sharing TESTS READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)
PAM - Patient Administration Management TESTS READY Use Gazelle External Validation Services (EVSClient) for HL7 msg validation.

Use the Gazelle Patient Manager as a simulator for PAM Patient Demographics Supplier and Consumer.

PDQ - Patient Demographics Query TESTS READY Use NIST PIX / PDQ tool.

Use Gazelle External Validation Services (EVSClient) for HL7v2 msg validation.

Also use the Gazelle PatientManager as a simulator for PDQ Consumer or Supplier.

PDQ-V3 - Patient Demographic Query HL7 v3 TESTS READY Use NIST PIX / PDQ tool. Also use the Gazelle PatientManager as a simulator for PDQv3 Consumer or Supplier.

Use Gazelle External Validation Services (EVSClient for HL7v3 msg validation.

PDQm - Patient Demographic Query for Mobile TEST READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)

Also use the Gazelle PatientManager as a simulator for PDQm Consumer or Supplier.

PIX - Patient Identifier Cross-Referencing TESTS READY Use NIST PIX / PDQ tool.

Use Gazelle External Validation Services (EVSClient) for HL7v2 msg validation.

Use the Gazelle Patient Manager as a simulator for PIX Manager, Consumer, and Source actors.

PIX-V3 - Patient Identifier Cross-Reference HL7 v3 TESTS READY Use NIST PIX / PDQ tool.

Use Gazelle EVSClient for HL7v3 msg validation.

PIXm - Patient Identifier Cross-Reference for Mobile TEST READY Actors that create or consumer FHIR Resources use Gazelle External Validation Services (EVSClient)

Also use the Gazelle PatientManager as a simulator for PIXm Consumer or PIXm Manager.

PLT - Patient Location Tracking No test tools.
PSA - Patient Synchronized Applications No test tools.
PWP - Personnel White Pages No test tools.
RFD - Retrieve Form for Data Capture TESTS READY Form Fillers use the RFD Testing System
RID - Retrieve Information for Display TESTS READY Use the MESA Tools
RMD - Remove Metadata and Documents Tool under development: MHD testing support in the NIST XDS Tools Release 5.x.x - expected Nov/Dec 2017
SeR - Secure Retrieve TESTS READY Use the Gazelle External Validation Services (EVSClient) - Assertion validators
SVS - Sharing Value Sets TESTS READY Use the Gazelle SVS Simulator.

Also use the Gazelle External Validation Service (EVSClient) for validation of the SVS messages.

XCA - Cross-Community Access TESTS READY Use the NIST XDS Toolkit v4.x.x
XCDR - Cross-Community Document Reliable Interchange No test tools
XCF - Cross Community Fetch TESTS READY Use the Gazelle XD* Client XCF simulator for sending XCF ITI-63 messages

Use the Gazelle External Validation Services (EVSClient) for ITI-63 request/response msg validation

XCPD - Cross-Community Patient Discovery TESTS READY Use the Gazelle XD* Client XCPD Simulator for sending ITI-55 messages.

Use the Gazelle External Validation Service - HL7v3 msg validator to validate ITI-55 and ITI-56 request & response.

XDM - Cross-Enterprise Document Media Interchange
XDR - Cross-Enterprise Document Reliable Interchange TESTS READY Doc Recipient use the NIST XDS Toolkit v4.x.x (or later release)

Doc Source use XDS Public Registry

Use Gazelle External Validation Services (EVSClient) for request/response message validation

XDS.b - Cross-Enterprise Document Sharing TESTS READY Doc Registry & Repository use the NIST XDS Toolkit v4.x.x (or later release

Use Gazelle External Validation Services (EVSClient) for request/response message validation

XDS-SD - Cross-Enterprise Sharing of Scanned Documents TESTS READY Content Creators use Gazelle External Validation Service (EVSClient) -- CDA Schematron and PDF/A validation
XDW - Cross-Enterprise Document Workflow TESTS READY Content Creators use Gazelle External Validation Service (EVSClient) -- XDW validator
XPID - XAD-PID Change Management Tool under development: XPID testing support in the NIST XDS Tools Release 5.x.x - expected Nov/Dec 2017
XUA - Cross-Enterprise User Assertion TESTS READY X-Service Users, use Gazelle External Validation Service (EVSClient) - Assertion validator

Also use XUA Security Token Service (STS)

Laboratory

Eric Poiseau is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
ILW
LAW TESTS READY Use the Order Manager and the Gazelle External Validation Service for HL7V2 message validation. / Refer to List of LAW pre-connectathon tests
LBL TESTS READY Use LBL simulator, and the Gazelle External Validation Service for HL7V2 message validation. / Refer to the List of LBL pre-connectathon tests.
LCSD TESTS READY Use the LCSD simulator, and the Gazelle External Validation Service for HL7V2 message validation. / Refer to List of LCSD pre-connectathon tests
LDA, LPOCT Use Gazelle External Evaluation Service for HL7V2 message validation.
LTW TESTS READY Use the Gazelle Order Manager, and the Gazelle External Evaluation Service for HL7V2 message validation. / Refer to the List of LTW pre-connectahton tests.
XD-LAB - Sharing Laboratory Reports TESTS READY Use the CDA validation tool from NIST or the Gazelle External Validation Services Client.

Patient Care Coordination

Steve Moore is the Technical Project Manager who oversees testing in this domain.

Profile Comment Tools to use / Notes
APE - Antepartum Education TESTS READY Content Creator actors use CDA validation tool from NIST
APHP - Antepartum History and Physical TESTS READY Content Creator actors use CDA validation tool from NIST
APL - Antepartum Lab TESTS READY Content Creator actors use CDA validation tool from NIST to do CDA R2 validation. No schematron test.
APS - Antepartum Summary TESTS READY Content Creator actors use CDA validation tool from NIST
CM - Care Management No tests defined No tools
CTNN - Composite Triage and Nursing Note TESTS READY Content Creator actors use CDA validation tool from NIST
EDPN - Emergency Department Physician's Note TESTS READY Content Creator actors use CDA validation tool from NIST
EDR - Emergency Department Referral TESTS READY Content Creator actors use CDA validation tool from NIST
EHDI-WD - Early Hearing Detection & Intervention Workflow Definition No tests defined No tools
ENS - eNursing Summary TESTS READY Content Creator actors use CDA validation tool from NIST
ETS - EMS Transport Summary TESTS READY Content Creator actors use CDA validation tool from NIST to do CDA R2 validation.
IC - Immunization Content TESTS READY Content Creator actors use CDA validation tool from NIST
ITS - Interfacility Transport Summary TESTS READY Content Creator actors use CDA validation tool from NIST to do CDA R2 validation. No schematron test.
LDHP - Labor and Delivery History and Physical TESTS READY Content Creator actors use CDA validation tool from NIST
LDS - Labor and Delivery Summary TESTS READY Content Creator actors use CDA validation tool from NIST
MDS - Maternal Discharge Summary TESTS READY Content Creator actors use CDA validation tool from NIST
NDS - Newborn Discharge Summary TESTS READY Content Creator actors use CDA validation tool from NIST
NN - Nursing Note TESTS READY Content Creator actors use CDA validation tool from NIST
PPOC - Patient Plan of Care TESTS READY Content Creator actors use CDA validation tool from NIST
PPVS - Post-partum Visit Summary TESTS READY Content Creator actors use CDA validation tool from NIST
PW - Perinatal Workflow No tests defined No tools
QED - Query for Existing Data TESTS READY No tools. Tests to exchange sample QED queries defined in actor test plans on MESA Tools Main Page.
RCG - Request for Clinical Guidance No tests defined No tools
RECON - Reconciliation of Diagnoses, Allergies, & Meds TESTS READY Content Creator actors use CDA validation tool from NIST
TN - Triage Note TESTS READY Content Creator actors use CDA validation tool from NIST
XBeR-WD - Cross-Enterprise eReferral Workflow Definition Tests under development Use XDW validator in Gazelle External Validation Service
XDS-MS - Cross Enterprise Sharing of Medical Summaries TESTS READY Content Creator actors use CDA validation tool from NIST
XPHR - Exchange of Personal Health Record Content TESTS READY Content Creator actors use CDA validation tool from NIST
XTB-WD - Cross-Enterprise Tumor Board Workflow Definition No tests defined No tools
XTHM-WD - Cross-Enterprise TeleHomeMonitoring Workflow Definition Tests under development Use XDW validator in Gazelle External Validation Service

Patient Care Devices

Paul Sherman is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
Pre-Connectathon Tests; RTM conformance is required for all except IDCO and RDQ (see below). Tests Ready PCD uses NIST PCD Tools for most HL7 v2 Pre-Connectathon tests. Links are provided here.

If an Isolated Test is available that is the required test. A few tests are at the Instance Test level. In that case, Instance Tests are the type test required. Most Isolated Tests include Instance Testing, and Instance Tests can be used as development tools for most tests. CAUTION: Select the correct URL for the type of test (Isolated or Instance) required for Pre-Connectathon testing – i.e., if an Isolated Test is available that is the required test; Instance Tests are required only if an Isolated Test is not available. The type of test is defined within the Gazelle test.

- Isolated Testing: http://ihe-pcd-precon.nist.gov/
- Instance Testing: http://ihe-pcd-con.nist.gov/

If the required test is an Isolated Test you must remember to post (i.e., commit) the test results within the test tool. For all tests upload the log to Gazelle and indicate Self Verified; comments may be included.

You can find the list of tests with identification of the type of test at PCD Connectathon ftp site.

DEC - Device Enterprise Communication Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected. There are 3 options: SPD, POI, WCM.
ACM - Alarm Communication Management Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected. There is one option: WCM.
IDCO - Implantable Device Cardiac Observation Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
IPEC - Infusion Pump Event Communication Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
PIV - Point-of-Care Infusion Verification Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
RDQ - Retrospective Data Query Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
RTM - Rosetta Terminology Mapping Tests Ready All PCD Profiles except IDCO and RDQ require conformance with RTM. Versions are available at [1]
WCM - Waveform Communication. Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
MEMDMC - Medical Device Management Device Management Communication Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.
MEMDLS - Medical Device Management Location Services Tests Ready Gazelle and NIST will provide tests appropriate to the actor you have selected.

Pharmacy

Eric Poiseau is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
CMPD - Community Medication Prescription and Dispense
DIS - Pharmacy Dispense Use Gazelle External Validation Service for CDA document validation.
HMW - Hospital Medication Workflow Use the HMW simulator. Use Gazelle External Validation Service for HL7V2 message validation.
PADV - Pharmaceutical Advice Use Gazelle External Validation Service for CDA document validation.
PRE - Pharmacy Prescription Use Gazelle External Validation Service for CDA document validation.

Quality, Research, Public Health

Lynn Felhofer is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
ADX - Aggregate Data Exchange TEST READY Content Data Structure Creator actor use the Gazelle External Validation Services (EVS client) - IHE - SDMX
BFDR-E - Birth & Fetal Death Reporting -Enhanced TESTS READY Form Filler, Form Mgr, Form Processor actors use the RFD Testing System
CRD - Clinical Research Document TESTS READY Form Filler actors use the Gazelle External Validation Services (EVS client) - CDA validator
CRPC - Clinical Research Process Content No test tool
DEX - Data Element Exchange No test tool
DSC - Drug Safety Content No test tool
EHDI - Early Hearing Detection & Intervention No test tool
EHDI-WD - Early Hearing Detection & Intervention Workflow Definintion No test tool
FP - Family Planning
HW - Healthy Weight TESTS READY Info Source and Form Receiver Msg Exporter actors use NIST HL7 v2.x Message Validation Tool
NANI - Newborn Admission Notification Information No test tool
PRPH-Ca - Physician Reporting to a Public Health Repository - Cancer Registry TESTS READY Content Creator actors use the Gazelle External Validation Services (EVS client) - CDA validator
QME-EH - Quality Measure Execution - Early Hearing No test tool
RM - Research Mapping No test tool
RPE - Retrieve Protocol for Execution No test tool
RSP - Redaction Services No test tool
SDC - Structured Data Capture No test tool
VRDR - Vital Records Death Reporting TESTS READY Form Filler, Form Mgr, Form Processor actors use the RFD Testing System

Information Source and Form Rcvr Msg Exporter actors use the Vital Records Validation tool from NIST

Radiology

Lynn Felhofer is the Technical Project Manager who oversees testing in this domain.

Profile Status of pre-Connectathon tests Tool to use / Notes
ARI - Access to Radiology Information TESTS READY MESA Tools
BIR - Basic Image Review (incl. BIR viewer on PDI media) TESTS READY No test tools. Image Displays see test plan at this link
CDS-OAT - Clinical Decision Support - Order Appropriateness Tracking TESTS READY No CDS-OAT-specific tools. Order Placer and Order Filler use Gazelle External Validation Service (EVSClient) to evaluate base requirements for RAD-2, 3, 4
CHG - Charge Posting TESTS READY MESA Tools
CPI - Consistent Presentation of Images TESTS READY Use DICOMScope
CXCAD - Presentation of Chest CAD SR No test tool
DBT - Digital Breast Tomosynthesis No test tools specific to DBT. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
DIFF - MR Diffusion Imaging No test tools specific to DIFF. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
ED - Evidence Documents No test tools specific to ED. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
FUS - Image Fusion TESTS READY MESA Tools
IID - Invoke Image Display No test tool; one pre-Connectathon test for Image Display to load test data to use for Connectathon testing.
IOCM - Image Object Change Management No test tool
IRWF.b - Import Reconciliation Workflow No test tool
KIN - Key Image Note TESTS READY MESA Tools
MAMMO - Mammography Image TESTS READY MESA Tools
MAP - Management of Acquisitoin Protocols No test tools.
MAWF - Mammography Acquisition Workflow No test tools specific to MAWF. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
MRRT - Management of Radiology Reporting Templates TESTS READY MRRT tool and MRRT template validator
NMI - Nuclear Medicine Image TESTS READY MESA Tools
PAWF - Post-Acquisition Workflow No test tool
PDI - Portable Data for Imaging TESTS READY Portable Media Creator actor use PDI test application from Northwestern
PDI - updates in the PDI extensions TI supplement No test tool
PERF - CT/MR Perfusion Imaging with Contrast No test tool specific to PERF. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
PGP - Presentation of Grouped Procedures TESTS READY MESA Tools
PIR - Patient Information Reconciliation TESTS READY Use MESA Tools
REM - Radiation Exposure Monitoring TESTS READY MOD actor use REM PixelMed DoseUtility
REM-NM - Radiation Exposure Monitoring for Nuclear Medican TESTS READY MOD actor use REM PixelMed DoseUtility
RWF - Reporting Workflow TESTS READY MESA Tools
SINR - Simple Image and Numeric Report TESTS READY MESA Tools
SMI - Stereotactic Mammography Image No test tool specific to SMI. Tests defined for MOD, Img Display & Img Mgr to exchange pre-connectathon samples & validate DICOM objects.
SOLE - Standardized Operational Log of Events TESTS READY Use Gazelle Security Suite to validate log event contents and send them to the Syslog Collector
SWF - Scheduled Workflow TESTS READY MOD actor use the Gazelle External Validation Service for DICOM object validation. Use Gazelle Order Manager as a Modality Worklist SCP. Use MESA tools for DICOM message exchange.

ADT, OP and OF actors use the Gazelle External Validation Service to check the HL7 messages you send.

OP, OF actors, use Gazelle Patient Manager as an ADT simulator to send RAD-1 and RAD-12 messages. Use Gazelle Order Manager as a simulator to send ORM messages, RAD-2, RAD-3. Use of MESA tools for DICOM-based workflows is optional.

Img Mgr actor use Order Manager as a simulator to send RAD-4 and RAD-13. Use MESA Tools for DICOM-based workflows.

No tools for Image Display & PPSM actors.

SWF.b - Scheduled Workflow.b TESTS READY MOD actor use the Gazelle External Validation Service for DICOM object validation. Use Gazelle Order Manager as a Modality Worklist SCP. Use MESA tools for DICOM message exchange.

ADT, OP and OF actors use the Gazelle External Validation Service to check the HL7 messages you send.

OP, OF actors use Order Manager as a simulator for HL7v2.5.1 order msgs: RAD-2, RAD-3. Use of MESA tools for DICOM-based workflows is optional.

IM actor use Order Manager as a simulator for HL7v2.5.1 order msgs: RAD-4, RAD-13. Use MESA Tools for DICOM-based workflows.

No tools for Image Display & PPSM actors.

SWF & PIR - as updated in the Multiple Image Manager/Archive (MIMA) TI Supplement No test tool
TCE - Teaching FIle and Clinical Trial Export TESTS READY MESA Tools
WIC - Web-based Image Capture No test tool
XCA-I - Cross Community Access for Imaging TESTS READY Init Img GW and Resp Img GW use XDS Toolkit v4.x.x

Also, use the Gazelle XD* client for sending RAD-69 and RAD-75 messages.

XDR-I - Cross-enterprise Document Reliable Interchange for Imaging No test tool
XDS-I.b - Cross-enterprise Document Sharing for Imaging TESTS READY Img Doc Source use XDS Toolkit v4.x.x (or later release)

Also, use the Gazelle XD* client for sending RAD-68, -69, -55 messages, and the Gazelle External Validation Service - WADO validator