Data Engineer

About

Description

A remote opportunity is available for a skilled and analytical Data Engineer to support research-driven data challenges. The role involves designing and maintaining scalable ETL pipelines, working with structured and unstructured data, and collaborating with data scientists on AI/ML modeling and experimentation.

Responsibilities

• Design and maintain robust ETL pipelines for diverse data sources
• Conduct exploratory data analysis (EDA) to derive insights
• Collaborate with data scientists and researchers on dataset preparation
• Manage data models, schemas, and databases for efficient data handling
• Write optimized SQL queries for data extraction and aggregation
• Ensure data integrity, quality, and security
• Automate data validation and reporting workflows

Qualifications

• Proficiency in Python and SQL
• Experience with ETL pipeline development
• Expertise with Pandas and NumPy for data manipulation
• Familiarity with AI/ML tools such as scikit-learn, Hugging Face Transformers, and OpenAI API
• Experience with databases like PostgreSQL and MySQL
• Skilled in EDA tools like Jupyter Notebooks, VS Code, or PyCharm
• Strong communication skills (written and verbal)
• Experience with vector search tools like Qdrant, FAISS, or Pinecone
• Familiarity with data visualization tools like Matplotlib, Seaborn, or Plotly

Application instructions:

• To apply, simply click the apply button.