Senior Spark/Pyspark

Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners.

We are looking for a Senior Spark/Pyspark (databricks) for an Oil Company

Requirements:
The data engineering team is asking for engineers to join the Data Engineering analytics team
· To focus on reworking and modernizing our python and pyspark ETL library and Delta tables.
o possibly leaning more toward software engineer than strict data engineer.
o if they have Databricks experience that would be great.
· To focus on data engineering to bring in new tables and curate them for end users.
o Candidate needs to have strong python/pyspark and SQL knowledge.
· To focus on building out our Data Quality framework with the Great Expectation spark library.

• Duration: Long Term Contract;
• Localization: Hybrid (with at least one time per week at the office.), Lisbon, Coimbra or Braga. Candidates must be living in Portugal.