Integrations / Instrument CSV import

Instrument CSV import into a LIMS.

Many instruments and data systems can write a CSV or delimited text file even when they offer no other integration. CTM scopes and builds CSV import paths that check every file before it touches the LIMS and make every rejection visible.

Why CSV imports fail quietly

A CSV import looks simple until a file arrives half-written, a sample ID loses its leading zeros after passing through a spreadsheet, a decimal comma appears on a workstation with different regional settings, or the same file is dropped twice. Each of these can put a wrong value in the LIMS without anyone noticing. A dependable import treats the file as untrusted input and checks it before writing anything.

Structure, encoding, and layout

  • Delimiter, quoting, header row position, and character encoding are fixed in the interface contract and checked on every file.
  • Required columns are verified by name, not position, so an extra column does not shift values.
  • Long layouts (one row per sample and analyte) and wide layouts (one column per analyte) are both workable, but each needs its own mapping.
  • Number, date, and time formats are parsed explicitly; locale-dependent values are rejected rather than guessed.
  • Files that do not match the agreed layout are quarantined whole, with a reason, instead of partially loaded.

Sample IDs and matching

The LIMS sample ID is the key. The import checks that each ID exists, that the sample is expected for this analysis, and that the ID has not been altered on the way, for example by leading-zero loss or scientific notation after a spreadsheet edit. QC rows are recognized by an agreed type column or naming convention. Rows that do not match go to an exception list; they are not attached to the nearest-looking sample.

Values, qualifiers, units, and dilution

Instrument files often contain text alongside numbers: less-than values, ND, over-range markers, or error codes. The mapping says how each is stored in the LIMS, usually as a qualifier plus the applicable limit. Units must be explicit per analyte, and dilution factors must come from one agreed place. If the file does not carry units, the contract records the assumed unit so a later template change is caught.

Watched folders, duplicates, and reruns

A watched folder needs a way to tell when a file is complete, an archive for processed files, and a quarantine for rejected ones. Each file is fingerprinted so the same content is not imported twice. When a sample is legitimately rerun, the new results are staged against the existing ones for review rather than overwriting them.

Audit trail and validation

Every import records the file name and fingerprint, arrival and processing time, the account or service that ran it, the results written, and the rows rejected with reasons. Validation runs a set of normal and deliberately broken files, including a truncated file, a wrong delimiter, a duplicate, an unmatched ID, and a qualifier value, and compares what reached the LIMS with what was expected.

Laboratories using Clearline LIMS can see how the product handles instrument result files in the Clearline LIMS guide to importing instrument results.

What CTM delivers

  • A written mapping from the instrument export to LIMS analyses, units, qualifiers, and QC types.
  • The parser or import component, tested against representative files outside production.
  • Rules for sample matching, reruns, and exceptions, agreed with the people who review results.
  • A validation record comparing imported values with the source export for normal and edge-case runs.
  • A runbook and change triggers for software updates, template edits, and new analytes.

Related guides and services

Integration work usually sits inside a broader workflow question. The lab informatics service maps the sample-to-report path the interface must serve, and legacy LIMS stabilization covers older or inherited LIMS installations where an import must be added without disrupting what already runs. Labs using Clearline LIMS can review the Clearline LIMS guide to importing instrument results.

See the LIMS instrument integration overview for interface patterns and how an engagement runs, or another technique guide:

What shapes cost and timing

The number of instruments and export templates, how consistent sample naming is, QC and rerun rules, LIMS import options, and how much of the mapping is already documented.

Fees and schedule are proposed after fit and scope are confirmed; they are not fixed by this page.

Questions labs ask

Is CSV good enough for instrument integration?

Often yes. A well-checked CSV import is transparent and easy to reprocess. It needs structure, identity, duplicate, and qualifier checks to be dependable.

What if analysts edit the file in a spreadsheet first?

Editing can change IDs, numbers, and dates. The better path is to import the file as exported. If edits are unavoidable, the import should detect altered IDs and formats and send those rows to review.

How are duplicate files prevented?

Each file is fingerprinted when it is processed. A file with the same content is rejected as a duplicate and logged.

Can one import handle several instruments?

Yes, when each instrument's layout has its own mapping and the import can tell which layout a file uses. Unknown layouts are quarantined.

Next step

Name the instrument, its software and version, what it exports today, the LIMS it needs to reach, and who owns failed imports. A redacted or synthetic example export helps more than a description.

Use the systems-need link on this page. Do not include credentials, regulated records, production exports, or client-sensitive material in initial intake.