Hadoop Kafka Developer

Full Time
Posted 2 weeks ago

 

Title: Hadoop Kafka Developer

Location: Louisville, KY

Duration: Contract , Long Term

Job Description :

 

  • Experience in validating the different source file formats to standard messaging format (ex. JSON). Understanding of Kafka streaming process and spark framework.
  • Experience in Validating Hive database tables using mapping/transformation logic with source files (ex. Avro, parquet, etc..) or staging tables.
  • Experience in Validating HBase database tables or similar column-oriented storage/NoSQL databases.
  • Experience in writing Python/Scala or other scripts to automate test execution.
  • Tokenization or Data masking knowledge and testing the same.
  • Test data setup/mockup knowledge in file systems and database tables.
  • Knowledge in analyzing the log files, error files for any data ingestion failures.
  • Knowledge or hands-on experience in Nifi, Kafka, Atlas, Schema Registry, Ranger, Oozie, GitLab, CI/CD, PyCharm, HDFS
  • Programming language knowledge in Python/Scala/ JAVA, HiveQL/ NoSQL/Spark SQL.

Job Features

Job CategoryHadoop Kafka Developer
ExperienceEntry Level

Apply Online

A valid email address is required.