Data Engineer

About

Description

Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients. We are currently looking for a Data Engineer to join our financial services client based in Centurion. As a Data Engineer, you will be responsible for designing, building, and maintaining data infrastructure, pipelines, and integrations to ensure efficient data collection, storage, processing, and consumption. Your goal will be to optimize databases, ensure data quality, and support analysts, developers, and business users by delivering clean, structured data for Business Intelligence (BI) and Machine Learning (ML). You’ll also manage and maintain cloud or on-premise data platforms, implement best practices, and ensure data security and accessibility.

Responsibilities

• Build strong professional relationships with stakeholders including business, analysts, engineers, architects, and developers
• Advise on data and analytic solutions that meet business requirements and collaborate on technical implementations
• Support and maintain production and non-production database systems and platforms
• Assist with database design and peer reviews
• Create and maintain data products and domains across various sources and consumers
• Develop and maintain data integration pipelines
• Automate data infrastructure deployment using CI/CD principles and manage monitoring, logging, and alerting
• Optimize databases with efficient queries, schema definitions, and performance tuning
• Implement solutions for operational reporting, BI, analytics, and ML
• Support model development including preprocessing, feature engineering, tuning, and MLOps
• Apply data governance standards covering security, ML, SDLC, change, incident, and release management
• Document data artifacts and solutions
• Maintain and improve the scalability, performance, and reliability of the data platform
• Mentor and train junior team members
• Stay up to date on data platforms, tools, and trends
• Research emerging technologies and solutions in data, analytics, and ML

Qualifications

• Completed relevant IT/Computer Science/Engineering degree or Diploma
• 8 years of technical working experience with major data platforms: SQL, PostgreSQL, Oracle, RDS, etc
• 4 years of hands-on experience with AWS and AWS analytics services such as S3, Athena, Glue, RDS, Redshift, Lake Formation, SageMaker, Lambda, etc
• Experience with AI platforms such as AWS AI, Azure AI, Google AI, OpenAI, Anthropic, or Meta is an advantage
• Strong technical, analytical, and problem-solving skills
• In-depth knowledge of data systems development and operations

Application instructions:

• To apply, simply click the apply button.