References: Data Pipeline Internals
-
Comma-separated values - Wikipedia - Covers CSV header conventions and field-delimiting rules, directly underlying this chapter's CSV Header and Pipe-Delimited Field sections.
-
JSON - Wikipedia - Explains JSON's object and array structure, the format this chapter's Node Record, Edge Record, Group Record, and Metadata Record sections all serialize into.
-
Serialization - Wikipedia - Defines serialization as converting in-memory data into a storable or transmittable format, directly underlying this chapter's JSON Serialization section.
-
Extract, transform, load - Wikipedia - Describes the general ETL pattern a data pipeline follows, the broader discipline this chapter's Data Pipeline and Data Transformation sections apply to CSV-to-JSON graph generation specifically.
-
Dublin Core - Wikipedia - Covers the metadata element set this chapter's Metadata Record, Version Metadata, and License Metadata sections apply to this project's own
metadata.jsonfile. -
Software versioning - Wikipedia - Explains version-numbering conventions, background for this chapter's Version Metadata section.
-
Creative Commons license - Wikipedia - Explains the CC BY-NC-SA license type this project's own
metadata.jsonuses, directly relevant to this chapter's License Metadata section. -
Reproducibility - Wikipedia - Covers reproducibility as a general standard in research and engineering, the principle this chapter's Reproducible Generation section applies specifically to a learning-graph generation pipeline.
-
python: json — JSON encoder and decoder - Python Software Foundation - The official documentation for Python's
jsonmodule, includingjson.dump(), the function this project's owncsv-to-json.pycalls to perform JSON Serialization. -
python: csv — CSV File Reading and Writing - Python Software Foundation - The official documentation for Python's
csvmodule, includingcsv.DictReader, the function this project's own pipeline scripts use to parse CSV Header and row data.