Credential Engine
|Data Engineer
Washington, District of Columbia, US
Summary
Led the design and deployment of an LLM-powered ETL pipeline to transform unstructured educational data for 60+ partner institutions, significantly enhancing data accessibility and consistency.
Highlights
Designed and deployed an LLM-powered ETL pipeline using the Gemini API, transforming unstructured educational data into CTDL-compliant formats for 60+ partner institutions.
Built scalable ingestion tools with Python and Flask, reducing partner onboarding time by 80% and enabling seamless integration for non-technical users.
Implemented schema validation, mapping, and audit traceability, ensuring data accuracy and regulatory compliance across data processes.
Led Agile sprint collaborations with stakeholders, integrating feedback for continuous pipeline improvements and feature enhancements.