ETL
ETL stands for Extract, Transform, Load: data is read from a source, transformed before loading and then transferred into the analytics store.
What does ETL mean?
ETL stands for Extract, Transform, Load: read data from a source, transform it according to defined rules and then load it into a target store. Preparation for analysis may include standardising units, mapping fields or separating invalid records. The defining feature is the order: transformation happens before loading into the designated analytics store.
In a fictional software project, a background job supplies its runtime as {"durationMs":90000}. The planned ETL step converts milliseconds to seconds: 90000 / 1000 = 90. Only then is {"durationSeconds":90} loaded into the analytics store. The field names and numbers are illustrative; no data pipeline has been run or speed measured.
With ELT, the raw data would first enter the target store and be transformed there. ETL places preparation before that load. Suitability depends on factors including the target system and required analyses; the letter order alone demonstrates no cost or performance advantage.
Sources
Related terms
- ELTELT stands for Extract, Load, Transform: raw data first enters the target store and is then transformed there for the required analyses.
- Data mappingData mapping defines how source data enters a target structure. Field names, meaning, units and error handling all need to fit.
- System integrationSystem integration links applications, data and work steps. Interfaces alone are insufficient: identifiers, field meanings and outcomes need to agree.
- Transactional inboxA transactional inbox uses durable message records to protect local processing against duplicate deliveries.
- Message acknowledgementA message acknowledgement tells the broker that a delivery has been received or processed according to the agreed rule.
- Retry jitterRetry jitter varies waiting times randomly to spread retries and reduce simultaneous requests from many clients.
Articles on this topic
APIs & Integration with ASES
ERP, CRM and shop cleanly connected