Protecting your network chromatography data system (CDS) data is critical and a service level agreement (SLA) with your IT provider is vital. What should be included? Are SLAs for in-house IT and SaaS (software as a service) similar?
Imagine you have finished validating your new chromatography data system (CDS) and you are looking around the lab with pride. Suddenly, the lab door busts open and standing in the doorway is your worst nightmare—Quality Assurance! They demand to see the agreement with your IT provider. Agreement? What IT agreement? The one required by EU GMP Annex 11 clause 3.1 (1). Oops! At this point, “Beam me up, Scotty” is not an option.
To avoid this scenario, “Questions of Quality” analyzes regulatory guidance to identify and discuss what should be in an IT agreement for any service provider that is supporting your multi-user CDS. Many regulated laboratories are taking the opportunity to migrate their IT infrastructure and applications, including CDS, laboratory information management system (LIMS) and other informatics applications, from on premises to cloud computing. One reason is financial. Software as a service (SaaS) is a revenue item directly off the bottom line vs. purchase, which is a capital cost amortized over three years.
Due diligence must be carried out when selecting a service provider and the selection must be subject to supplier assessment and report (1). Different regulations consider the knowledge, professional experience, and training of IT cloud suppliers about computerized systems, data protection, privacy, and GxP legislation depending on the service provided (1–5). However, a discussion of this is outside the scope of this column. In addition, the impact of data privacy and artificial intelligence (AI) legislation on healthcare regulations is emerging, but will not be considered here.
While there has been a requirement for an IT agreement in Annex 11 since 2011, it is vague: Include clear statements of the responsibilities of the third party (1), but nothing further. However, EU GMP Chapter 7 on Outsourcing has requirements related to data ownership, review, and availability (6). In addition, several regulatory publications and updates shown in Figure 1 also impact on our discussion. As background reading, a two-part eBook is available from LCGC, entitled Is Chromatography Ready for the Cloud? (7,8).
The principles outlined here are intended for a CDS but can be applied to other internal networked or SaaS computerized systems.
There are an abundance of regulations and regulatory guidance on IT service level agreements (SLAs) that span GMP (Good Manufacturing Practice), GLP (Good Laboratory Practice), and GCP (Good Clinical Practice). We will collate all into a single comprehensive approach regardless of the GxP discipline that a laboratory could comply with. This selection ignores 21 CFR 211 and 21 CFR 11 regulations as there is little from the IT support perspective. Figure 1 depicts an overview of GxP requirements for IT agreements. GMP regulations and guidance documents to consider are:
FIGURE 1: Overview of GxP regulatory requirements for IT agreements.
GLP has the largest number of publications impacting IT agreements:
GCP has two guidance documents that have input into IT agreements:
Most of the above provide a generic approach to the contract requirements; however, OECD 17.1 lists the monitoring requirements of the test facilities which use cloud-based solutions (2) and MHRA ‘GXP’ Data Integrity Guidance and Definitions spotlights technical agreements or contracts with IT Suppliers and Service Providers(10).
In this column, the following terms are used:
When using the cloud, you must understand the risks; one is that your data are on someone else’s computer. You don’t control what they do with the platform that contains your data. All you have is an agreement between you and the service provider. Another way to look at this is described and visualized in Figure 1 in reference (7). It depicts a dwarf blue star (your laboratory) next to a black hole (your data). Once your data go past the event horizon of the black hole, you have no clue what is happening to your data. The SLA and the ability of the service provider to conform to it are critical.
Who are involved with a SaaS CDS? Figure 2 shows the entities involved with a SaaS CDS and the responsibilities of each for the correct functioning of the CDS as well as overall compliance and data integrity. Like a house of cards, all must work to ensure that the system functions and is compliant. Starting from the bottom is the ISP, followed by the SaaS provider, the company IT department, and, balanced precariously on top, is your laboratory.
FIGURE 2: Entities involved with a SaaS CDS implementation.
The ISP will not be subject to GxP regulations (2,3,16), but should conform to a quality standard such as ISO 27001 (17) or system organization and controls (SOC) (2). The SaaS supplier will need to have done due diligence to ensure that the ISP they use is fit and competent, followed by an agreement between the ISP and the SaaS provider.
Our focus is on the agreement between the SaaS provider and your organization. A CDS SaaS provider is your IT department managing the CDS application, database, and virtual infrastructure. Therefore, their staff, including sub-contractors, must have awareness of GxP requirements along with education, training, experience, and competence to do their tasks, as outlined in Figure 3.
FIGURE 3: Scope of a CDS service level agreement for internal IT and SaaS providers.
Remember that the accountability for work conducted on your behalf by the SaaS provider and the ISP remains with you.
Using the regulations in Figure 1, we have devised Figure 3 to outline what could be included in any SLA for an IT provider. There are six sections depending on the scope of the services offered by the IT or SaaS provider. These are divided as follows:
Two areas that are specific for a SaaS service provider:
A section on definition of terms and abbreviations is also required (8). Note an SLA must be reviewed periodically and updated (if necessary) as required by OECD 17.1 and EMA clinical guideline (2,4).
Regardless of approach, addressing the roles, responsibilities, and accountability are key to understanding regulatory expectations and ensuring data quality and integrity. Within an SLA, the roles and responsibilities must be described between the laboratory and the service provider:
Figure 3 shows the scope of IT services that could be included in an SLA depending on where it is hosted.
Within cloud or on-premise environments, internal IT plays the same role for managing application configuration under change control and user account management: account allocation and privileges to the authorized individuals. In addition, an SLA could cover the number of user licenses and types (8). Therefore, written procedures with workflows, roles, and responsibilities defining who does what are essential for control and compliance.
Any incidents with the CDS may be recorded first by your organization’s IT help desk for resolution or escalation or direct to the SaaS provider. It is a requirement to discuss the detailed workflow of the help desk in an SLA (18). This provision can be discussed within IT at two levels:
The staff of both help desks must be trained in GxP regulations including data integrity (18).
The following points should be incorporated into an SLA:
Annex 11 requires that IT infrastructure should be qualified (1). As part of the supplier assessment, how is this achieved by the SaaS provider? A regulated laboratory needs to understand the creation, configuration, integration, and operation of virtual infrastructure components for the CDS as part of the supplier’s QMS (see Figure 2). Evidence of qualification may be required for audit and inspection, again a requirement for the SLA.
Various GxP sources stress the potential risks associated with electronic data protection including IT cyber security when using cloud computing:
For external service suppliers, ISO 27001 (17), NIST Cybersecurity Framework (CSF2) (21), and national or supranational laws on cyber security could also impact an SLA.
OECD 17.1 offers particular attention to data protection and the secure physical location of data(2). From a physical standpoint, external security and access, pest control, temperature, fire suppression measurements, and emergency power are the key factors that need to be considered. For more details please see reference (14) and the LCGC eBook 1 (7).
An accurate time stamp is a regulatory requirement (1,22) and expectation (4,5,23) and is an imperative function for both on-premise and SaaS CDS systems. Time synchronization is the key to ensuring the authenticity of every CDS activity including the audit trail and an SLA should specify the trusted time source, time and date format, and time zone reference if used (18).
With SaaS CDS application, there is a critical difference between on-premise and cloud: you are contractually obliged to take software updates regularly (for example, quarterly). The CDS SaaS supplier has a vital role to consider the following factors:
For preference, SaaS suppliers should aggregate software releases into an annual upgrade. This approach is more practical where laboratories have more time to evaluate the changes instead of implementing changes every three or four months—hence the validation treadmill (8).
There must be enough fault-tolerant and secure disk space for data storage and e-archive. In essence, SaaS will allow expandable data storage; however, as part of the measured service with the SaaS provider, the laboratory will pay for this as part of an SLA or contract.
Where are you going to store your chromatography data for the record retention period? You can store data within the cloud or on-premise, but you need to consider the following:
Which records are to be archived (2), for example, chromatographic data and meta data including sequence file, instrument control method, acquisition and processing methods, integration of the data and calculation of the final results, audit trail entries to comply with 21 CFR 211.194(a) (24) with further information in reference 18.
Archiving retention period, which varies throughout GxP regulations (2).
Indexing and accessibility of archived records: Records should be “locked” such that they can no longer be altered or deleted without detection (2,13). Section 8 of OECD No 15 also provides good advice for an archive within a live system (13). MHRA 6.2 also requires that dynamic data remain dynamic (10).
Checks to ensure data are still readable following system upgrades: For some systems, the software including the application and operating system may need to be preserved if you want to reprocess data.
One key difference between on-premise IT and SaaS is data location. In SaaS, CDS data resides in the cloud, but the question remains: Do we need to know the exact location of the stored data?
Regulations and guidance documents are inconsistent (Table 1). Location is never defined adequately. This approach is not practical, and regulators must provide a definitive statement. For example, OECD 17.1 should provide explicit advice but fails miserably: Some GLP compliance monitoring authorities require details on location of a cloud archive for physical verification (2). This is as useful as a chocolate teapot.
The physical location of the data center containing the hardware and SaaS application may be determined by country legislation or company policy, otherwise location could be an area or URL (uniform resource locator) rather than a postal address.
CDS holds critical GxP data, so backup and restoration is a crucial requirement of an SLA. GMP regulations are vague requiring regular backups of all relevant data should be done (1,22,24). Annex 11 goes further: Integrity and accuracy of backup data and the ability to restore the data should be checked during validation and monitored periodically (1). How often are test restores performed by the service supplier, and how successful are they?
It is important for the lab to define:
Without back up there is no DR (2,14,16). Business continuity is focused on alternative working arrangements such as implementing data failover to a separate location. EU clinical guideline requires contingency plans in an SLA and address expectations about potential system down-time (4).
OECD documents (2,14) consider the following requirements for an SLA. The list also interprets some of the requirements as per GAMP 5 SE (16).
It is imperative that any DR plan is reviewed regularly to ensure all systems are included and updated to accommodate any changes in technology. Regular testing of a DR plan is critical to demonstrate it works.
Metrics need to be established regarding backup operations, such as percentage of successful backups, failures, and successful test restores.
Although FDA translates backup as archive in Q1 of the 2018 Data Integrity guidance (25), backup should not be used as a means of archive (3,16).
Examples associated with performance monitoring metrics were provided earlier. A laboratory must define metrics with acceptance limits and review monthly reports to ensure the performance of the IT provider. If the acceptance limits are exceeded, for example, system downtime, it would trigger discussion between the organization and the service provider and could lead to a financial penalty. A SaaS CDS supplier is responsible for delivering automatically generated metric reports (8).
Right for the laboratory audit and inspection has to be granted by the SaaS provider or in-house IT. This requirement is included in several GxP guidances:
The SLA clause for audit and inspection should reflect the following points:
The timely response of any service provider to audit or inspect findings must be specified in the SLA (4). Another area to check is the ability of the SaaS provider to protect your data and prevent other tenants from accessing your data and vice-versa. Competent resources should also be available from the service supplier for audits and inspections.
Audit includes periodic review (2); for more details of the scope refer to Annex 11 clause 11 (1).
The regulators are inconsistent.
ISPs such as Amazon, Microsoft, and Google produce white papers discussing GxP compatibility of their services, but this is outside the scope of this column.
This is a major problem area for cloud computing. The regulated company always owns the data managed by the cloud services (19), and an SLA should state this (3). If the contract is ended or voided, say by a merger with another service provider, a clear roadmap of data migration from the SaaS CDS to the laboratory must be agreed upon and included in an SLA. In case of bankruptcy of the SaaS provider or contract termination, all data and metadata (including audit trail and electronic signatures) must be returned to the chromatography laboratory. According to OECD 17.1, a SaaS provider should destroy all the data after transfer (2) and this would be part of an SLA.
Chromatographic data are dynamic and so must remain dynamic
(10,25) and PDF copies of data will not suffice.
The biggest problem with chromatographic data, and laboratory data in general, is that the application that generated the data is needed to access, view, and interpret them. This is a major problem with cloud computing: Once in the cloud, can you ever return?
A regulated chromatographic laboratory must use validated CDS regardless of whether it is in-house or SaaS. If the SaaS claims the CDS is validated to pharmaceutical industry standards, then the QMS and validation documentation must be audited as part of the supplier assessment. This includes detailed examination of specifications, coding, testing, and release documentation to ensure it is consistent with the laboratory’s own approach. The validation documents should be stored securely by the SaaS provider and must be available for laboratory audit and regulatory inspection. As noted earlier, CDS SaaS providers unwilling to allow audit and inspection of validation documents should not be used.
Always remember that accountability remains with the regulated company. An SLA is a key component for managing and monitoring interaction with your IT service provider (internal IT or SaaS CDS). In this column, we have critically reviewed GxP regulations and guidance on cloud computing to provide an interpretation for an SLA. The biggest difference with SaaS relates to continuous software upgrades and the impact on CDS validation. The inconsistencies of regulations are also discussed, with the major gap a lack of clarity on data location.
We wish to thank, in alphabetical order, Monika Andraos, Akash Arya, Markus Dathe, Jim Henderson, Misty Hill, Eberhard Kwaitkowski, and Yves Samson for their constructive review comments that have improved this column.
Bob McDowall is director at R.D. McDowall Ltd, Bromley, Kent, UK. A company involved in process redesign, the specification, implementation and validation of computerized systems, laboratory digitalization, data integrity assessment and remediation, training in these areas and auditing regulated organizations in the pharmaceutical and allied industries. He is also a member of the LCGC International Editorial Advisory Board (EAB).
Mahboubeh Lotfinia works as a qualified person and quality partner at F. Hoffmann-La Roche and is trained in GMP/GDP audit execution and CSV (computerized system validation).
Advanced LC–MS Analysis for PFAS Analysis in Eggs
October 11th 2024The European Commission's regulation on maximum levels for certain contaminants in food highlights the need for precise and reliable methods to quantify per- and polyfluoroalkyl substances (PFAS) in various food matrices. This article discusses development and validation of a robust method for analyzing 21 PFAS compounds in chicken eggs using solid-phase extraction (SPE) and liquid chromatography–mass spectrometry (LC–MS).