Data Engineer&
Fidel Consulting KK
Tokyo, Tokyo, Japan
1 日前

Position Name : Data EngineerResponsibilities : Collaborate with users and project team on requirements and expectationsAnalyze business requirements, and create proper data solutions that meet functional and non-functional requirementsDefine the data architecture, structure, storage, and security model of data in HDFS, Hive, HBase, Solr, RestAPIDesign and implement highly scalable data pipelines in Scala / Spark / Java for processing of extremely large amounts of dataCreate and maintain reusable frameworks for data ingestion, validation, normalization, and transformationAutomate Unit testing and release with CI / CD pipelineCreate scripts for operations, releases, data migrations, data validationsMaintain data lineage informationProvide technical support for releases, issues, and incidentsQualification : Minimum 3- 4 years of working experience as a developer or data engineerSolid knowledge and experience of the Hadoop ecosystem : HDFS, Hive, HBase, Phoenix, Solr, Oozie, Impala, Knox, Zookeeper, YARN, Spark, Livy, HUE, ZeppelinStrong programming skills in Scala and SparkStrong capabilities in designing Database schemas on data platformGood knowledge of Oracle database, MS-SQL Server, MongoDB, Kerberos, Linux, networkingProficient in SQL, shell scripting, git, unit testing, CI / CD toolsUnderstanding of design principles, coding standards, and best practicesGood problem-solving skillsGood data analytics skillsExcellent communication, presentation, and interpersonal skillsPreferred Qualification : Understanding of REST API, micro-services, ETL, and Salesforce is preferredHand-on experience with Cloud services is preferredUnderstanding of streaming data processing and change data capture is preferredExperience with BI tools is preferredDetailed and precise, able to drive alone the design and development of the complex systems.

Able to articulate technical aspects in an easy-to-understand way for non-developersStrong performer with a focus on delivery, fast learning, and able to apply his knowledge in various domains.

  • Willing to learn new technologies and pick up challenging workTeam player Company Description One of the world's leading professional services companies, transforming clients'
  • business, operating and technology models for the digital era. Their unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses.

    Headquartered in the U.S., this company is one of the Fortune 500 companies and is consistently listed among the most admired companies in the world.

    Passive smoking measures Indoor smokingDesignated smoking area . Skillset Required : Japanese3, English3, Data Engineer, CI / CD, Scala, Spark, Java , HDFS, HBase, RestAPI


    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    "続行" をクリックすると、私は neuvoo の同意を私のデータを処理し、私に電子メールのアラートを送信するには、neuvoo の プライバシーポリシー の詳細を与える。私の同意を撤回するか、いつでも退会することがあります。