Data Engineer (DE)

KeyResponsibilities:

• Design,build,andmaintaindatapipelinestosupportanalytics,reporting,and business intelligence.
• DevelopandoptimizeETL(Extract,Transform,Load)processesforefficientdata movement and transformation.
• Managestructuredandunstructureddatafrommultiplesources,ensuringdata integrity and consistency.
• WorkwithMongoDBandotherdatabasestomodelandprocesslargedatasets efficiently.
• DeployandmanagedatastoragesolutionsonAWScloudinfrastructure(e.g., S3, RDS).
• Collaboratewithsoftwareengineers,andbusinessteamstodesignand implement scalable data solutions.
• Developautomatedmonitoringanddataqualityvalidationprocesses.
• Optimizequeryperformanceanddatabaseindexingforlarge-scaledatasets.
• Stayupdatedwithemergingtrendsinbigdata,cloudcomputing,andAI-driven data engineering.

Qualifications:

• ProvenexperienceasaDataEngineerorinasimilarrole.
• StrongproficiencyinSQLandexperiencewithNoSQLdatabases(MongoDB, DynamoDB, etc.).
• Hands-onexperiencewithdatapipelinetoolslikeApacheAirflow,Luigi
• Familiaritywithbigdataprocessingframeworks(Spark,Hadoop,etc.).
• ProficiencyinPythonorJavafordataprocessingandautomation.
• ExperienceworkingwithRESTfulAPIsandintegratingdatafrommultiple sources.
• Goodknowledgeofdatasecurity,governance,andcompliancebestpractices.

PreferredSkills:

• Experiencewithreal-timestreamingdataprocessing(ApacheKafka,AWS Kinesis, RabbitMQ).
• Knowledgeofcontainerization(Docker)fordataservices.
• FamiliaritywithmachinelearningworkflowsandAI-drivendataengineering.
• UnderstandingofCI/CDpipelinesfordatainfrastructure.
• Experienceworkingwithbusinessintelligence(BI)toolslikeTableau,Looker,or Power BI.