We use technical cookies and Zorky's de-identified visit log. Yandex Metrica (data is stored on servers in Russia) runs only with your consent. We never sell data. More about cookies and statistics.
Zorky is in test mode — everything is free. Jobs and company pages are open to everyone; links to postings and your personal feed open after you sign up. Sign up →
ZorkyZorky
Location
Where are you looking for work?
All countries →
English
@termdocs
← All jobs

Senior Data Engineer

SeniorremoteIndia, IN2w ago
Market insights
📊 Data Engineering: salaries and demand on the market
Stack
azureclouddatabricksdelta lakegoogle cloudoraclepysparkpythons3sparksql
Details
Experience
4+ years
Show company and link
Free, after you sign in.
Apply
Upload your CV — employers and recruiters from different countries looking for your profile can contact you directly.
Send your CV →
Description
Accountabilities:
  • Design, develop, and optimize scalable ETL/ELT data pipelines for batch and real-time processing using Python, SQL, PySpark, Spark Structured Streaming, and Delta Live Tables.
  • Implement and maintain Medallion Architecture, organizing data into Bronze, Silver, and Gold layers to support data quality, performance, and analytical requirements.
  • Process terabyte-scale datasets using distributed computing techniques, ensuring pipeline reliability, scalability, and efficient resource utilization.
  • Manage Databricks environments, including workflows, clusters, Delta Lake, and related lakehouse components.
  • Implement Unity Catalog for metadata management, granular access controls, OAuth-based authentication, and enterprise-level data security and governance.
  • Develop and execute cloud migration strategies for legacy databases, including Oracle, Teradata, and SQL Server, to cloud-based data platforms and storage solutions such as Google Cloud Storage, Amazon S3, Azure Data Lake Storage, Snowflake, and Amazon Redshift.
  • Build and maintain CI/CD pipelines using Terraform and GitHub Actions to automate infrastructure provisioning, data pipeline deployments, testing, and monitoring.
  • Develop custom data processing scripts and data-driven APIs using Python and web frameworks such as Flask.
  • Use Docker to containerize data processing workloads and support portable, consistent deployment environments.
  • Evaluate emerging technologies and approaches for data-inten
Full description, company and the link to apply — after you sign in. Sign in
Employer contacts (email/phone/telegram) are hidden from the public preview. Send your CV so employers can reach you directly.
Report this job
Urgent question? Message @termdocs