Tag Archives: hadoop

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.createFileWithMode0(Ljava/lang/String;JJJI)Ljava/io/FileDescriptor

Questions: I have a Spark project that used to work lately . the project gets a CSV , and add two fields to it then it outputs with saveasTextfile() the content of a JavaPairRdd. my Spark version is : 2.3.0 my java version : 1.8 the project runs in an Eclipse IDE under windows 10.… Read More »

Maven can't find target/class directory using code from Hadoop: the definitive guide 4th edition

Questions: Recently I am learning Hadoop: the definitive guide 4th edition and trying to run the code (available on https://github.com/tomwhite/hadoop-book). But after installing hadoop, maven, and type the % mvn package -DskipTests I encounter the following problem: [INFO] Hadoop: The Definitive Guide, Project ………….. SUCCESS [ 1.336 s] [INFO] Common Code …………………………………. FAILURE [ 3.347… Read More »

Hadoop YARN application – appState 'Failed'

Questions: So I’m trying to write a YARN application and run it on Azure HDInsight Linux clusters. I’m working on IntelliJ community edition. I’m new to yarn and azure so I don’t really know how it works I tried this same code on the amazon web services equivalent and it ran just fine This is… Read More »

Maven exception in compiling Hadoop for 64bits

Questions: I’m compilling hadoop 2.4.0 on Ubunto 64bit using Maven here is the information about versions of Maven and JDK $ mvn -version Apache Maven 3.5.3 (3383c37e1f9e9b3bc3df5050c29c8aff9f295297; 2018-02-24T19:49:05Z) Maven home: /opt/apache-maven Java version: 1.8.0_181, vendor: Oracle Corporation Java home: /usr/lib/jvm/java-8-oracle/jre Default locale: fr_FR, platform encoding: UTF-8 OS name: “linux”, version: “4.15.0-29-generic”, arch: “amd64”, family: “unix”… Read More »

Installing Hadoop on MacOS resulting in build failure with CMake

Questions: I am trying to build the hadoop native for the first time as given below [ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.0.3:cmake-compile (cmake-compile) on project hadoop-common: CMake failed with error code 1 -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.0.3:cmake-compile (cmake-compile) on project hadoop-common: CMake failed with error code 1 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)… Read More »

HBase [ERROR]: org.apache.hadoop.hbase.client.AsyncProcess – Cannot get replica 0 location for

Questions: I have this error when I try to load data into my HBase table with my Talend Job: [ERROR]: org.apache.hadoop.hbase.client.AsyncProcess – Cannot get replica 0 location for {“totalColumns”:2,”families”:{“0”:[{“timestamp”:1525346138064,”tag”:[],”qualifier”:”CURRENT_VALUE”,”vlen”:8},{“timestamp”:1525346138064,”tag”:[],”qualifier”:”LIMIT_REACHED_FLAG”,”vlen”:1}]},”row”:”\\x8B\\x00EXABEAT_DISPATCHER\\x00ID_LOG_DETTAGLIO”} I need to understand why this error appeared. Thanks Answers: