Data Engineer

The Role

The Data Engineer will design, develop and support secure, scalable backend applications using .NET Core, C#, the Microsoft technology stack and AWS cloud services. The role focuses on building reliable APIs, microservices and event-driven integrations using AWS services such as SNS, SQS, Lambda, EventBridge, API Gateway and managed data services.

• Analyze business and technical requirements for backend, API, cloud and integration solutions
• Design and develop .NET Core applications, REST APIs, microservices and reusable integration components
• Build AWS-based event-driven solutions using SNS, SQS, Lambda, EventBridge and API Gateway
• Apply asynchronous messaging, queue-based processing, retries, dead-letter queues and idempotency patterns
• Create and maintain technical documentation, API contracts, message schemas and operational support notes
• Collaborate with product, architecture, QA, DevOps/SRE, cloud platform and vendor teams

Responsibilities

• Design, develop, test and maintain backend applications using .NET Core, C#, ASP.NET Core Web APIs, Entity Framework Core and related Microsoft development frameworks.
• Build secure RESTful APIs and integration services with clear contracts, versioning, validation, authentication, authorization and effective error handling.
• Implement event-driven and asynchronous communication patterns using AWS SNS, SQS, Lambda and EventBridge, including publish/subscribe, queue-based processing, retries, dead-letter queues and message tracing.
• Support cloud-native workloads on AWS using services such as API Gateway, Lambda, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.
• Apply microservices, distributed systems, resiliency, observability, logging and monitoring practices to improve system reliability and supportability.
• Troubleshoot and resolve application, API, database, messaging and cloud infrastructure issues across development, test and production environments.
• Create technical specifications, solution notes, sequence diagrams, API contracts, event/message schemas and operational documentation.
• Support CI/CD, automated testing, code reviews, release activities and infrastructure as code using tools such as Git, Bitbucket, Jira, Confluence, Terraform, CloudFormation, Jenkins or GitHub Actions.
• Collaborate with product owners, business analysts, architects, QA, DevOps/SRE, cloud platform teams and third-party vendors to deliver high-quality solutions.
• Contribute to engineering standards, reusable patterns, documentation and continuous improvement across the development team.

Requirements

• Bachelor’s degree in Computer Science, Information Technology (or similar)
• 6-8 years of software development experience across design, development, testing, release and production support.
• Strong hands-on experience with .NET Core / .NET 6+, C#, ASP.NET Core, Web APIs, Entity Framework Core, LINQ, asynchronous programming and secure coding practices.
• Experience with the broader .NET and Microsoft stack, including Visual Studio, NuGet, dependency injection, configuration management, authentication/authorization, unit testing and diagnostics.
• Hands-on AWS development experience with SNS, SQS, Lambda, EventBridge, API Gateway, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.
• Practical knowledge of event-driven architecture, including publish/subscribe, queue-based processing, fan-out, dead-letter queues, retry policies, idempotency, correlation IDs and eventual consistency.
• Experience with microservices, REST APIs, OpenAPI/Swagger, JSON, XML, API-led integration and service-to-service communication.
• Working knowledge of SQL Server, PostgreSQL and NoSQL databases such as MongoDB or DynamoDB.
• Experience with Docker, Kubernetes/EKS, CI/CD, Git-based development, automated builds, deployment pipelines and infrastructure as code using Terraform or CloudFormation.
• Familiarity with engineering and testing tools such as Postman, JMeter, Swagger/OpenAPI, Jira, Confluence, Bitbucket and monitoring/logging platforms.
• Good understanding of unit testing, integration testing, contract testing, performance testing and test automation practices.
• Understanding of application security, secrets management, encryption, least-privilege access, OWASP principles and secure API design.
• Strong troubleshooting and analytical skills across application code, APIs, databases, queues, cloud services and deployment pipelines.
• Good communication, collaboration and documentation skills with the ability to explain technical concepts clearly.
• Ability to work effectively in Agile delivery teams and coordinate across product, architecture, engineering, QA, DevOps/SRE and vendor stakeholders.
• Organized, detail-oriented and able to manage multiple priorities in a dynamic environment.