Senior AI Data & Integration Engineer — New York, NY
Зарплата не указана
ОткликнутьсяAbout The Opportunity
A fast-scaling AI infrastructure startup in the Enterprise Data & Intelligent Automation sector, we build unified data ingestion, transformation, and orchestration platforms that power generative AI, real-time analytics, and cross-system integrations for Fortune 500 teams. Our engineers architect scalable, secure, and low-latency data pipelines that connect siloed enterprise systems—enabling seamless AI workflows across cloud, on-prem, and edge environments.
Role & Responsibilities
• Design and deploy end-to-end data pipelines that ingest, transform, and serve data for LLMs, ML models, and automation workflows.
• Integrate disparate enterprise systems (CRM, ERP, SaaS tools) via APIs, webhooks, and event-driven architectures.
• Optimize data flow performance and reliability using Apache Kafka, Airflow, or similar orchestration tools.
• Implement data quality checks, lineage tracking, and schema enforcement for governed AI training and inference.
• Collaborate with AI/ML teams to tune feature pipelines, reduce latency, and align data structures with model requirements.
• Define and enforce data governance, security, and compliance standards across hybrid cloud environments.
Skills & Qualifications
• Must-Have
• Python
• Apache Kafka
• Apache Airflow
• SQL
• RESTful APIs
• Cloud Platforms (AWS/Azure/GCP)
• Pandas
• Git
• Preferred
• Pyspark
• dbt
• Prefect or Dagster
Benefits & Culture Highlights
• Hybrid flexibility with core in-office collaboration days and remote autonomy.
• Equity stake and early-employee impact in a VC-backed AI infrastructure startup.
• Ongoing learning stipend for certifications and conferences in data/AI engineering.
Skills: restful apis,azure,aws,sql,dbt,apache kafka,gcp,pandas,python,git