Skip to navigation Skip to content
Simon Technology Blog
  • Architecture
  • Cloud
  • Database
  • Develop
  • Hardware
  • Industry
  • Language
  • Mobile
  • Opensource
  • OS
  • Web
Main Navigation

Tag: Hadoop

Hadoop – Is Cassandra for OLAP or OLTP or both?

Cassandra does not comply with ACID like RDBMS, but CAP. Therefore, Cassandra selects AP from CAP and leaves it to the user for adjustment consistency.
I definitely can’t use it. Cassandra conduct

October 12, 2021By Simo Hadoop Both, Cassandra, for, Hadoop, OLAP, or OLTPLeave a Comment

Hadoop – Kafka Spark streaming: Unable to read

I am integrating Kafka and Spark, using spark-streaming. I created a theme as a producer of Kafka:

bin/kafka-topics.sh –create –zookeeper localhost:2181 –replication-factor 1 –partitions

October 12, 2021By Simo Hadoop Hadoop, Kafka, media, Message, read, SPARK, stream, UnableLeave a Comment

Hadoop (1) Ali Cloud Hadoop Cluster Configuration

Three ECS cloud servers

1.1 Create /bigdata directory

mkdir /bigdata
cd /bigdata
mkdir /app 1.2 Modify the host name node01, node02, node03

1.3 Modify the hosts file

vim /e

October 12, 2021By Simo Hadoop Ali, Cloud, cluster, configuration, HadoopLeave a Comment

Hadoop SQOOP instance

hadoop sqoop (instance) day-1 sqoop: is an open source tool, mainly used to transfer data between Hadoop and traditional databases (mysql). Import data from a relational database into Hadoop’s HDFS

October 12, 2021By Simo Hadoop Hadoop, instance, SqoopLeave a Comment

How to read the ORC file in the Hadoop stream?

I want to read the ORC file in mapreduce on Python. I try to run it:

hadoop jar /usr /lib/hadoop/lib/hadoop-streaming-2.6.0.2.2.6.0-2800.jar
-file /hdfs/price/mymapper.py
-mapper’/usr/local

October 12, 2021By Simo Hadoop file, Flow, Hadoop, How, Medium, ORC, readLeave a Comment

Hadoop Hive-2.3.5 installation

hadoop hive-2.3.5 installation:

Unzip the file: [[email protected] opt]# tar -zxvf apache-hive-2.3.5-bin.tar.gz -C /opt

Establish a soft connection: [[email protected] opt]# ln -s apach

October 12, 2021By Simo Hadoop 2.3.5, Hadoop, hive, installationLeave a Comment

Hadoop – SQOOP cannot be imported into form

I am running a command on sqoop

sqoop import –connect jdbc:mysql://localhost/hadoopguide – table widgets My sqoop version: Sqoop 1.4.4.2.0.6.1-101
Hadoop – Hadoop 2.2.0.2.0.6.0-101

Tak

October 12, 2021By Simo Hadoop form, Hadoop, import, Sqoop, UnableLeave a Comment

Hadoop – Apache ozie loading Sharelib failed

I got the following oozie.log:

org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An

October 12, 2021By Simo Hadoop apache, Failure, Hadoop, loading, Oozie, SharelibLeave a Comment

Hive – Hadoop merged file

I have run a map job with only 674 mappers, and hive has generated 674 .gz files, and I want to merge these files into 30-35 files. Pass Do not get the merged output, try the hive megre mapfilse at

October 12, 2021By Simo Hadoop file, Hadoop, hive, mergerLeave a Comment

Hadoop: Specify YARN Queu for DistCP

On our cluster, we set up a dynamic resource pool.

Set the rules so that the first yarn will look at the specified queue, and then Check the username, then check the main group…

But u

October 12, 2021By Simo Hadoop designated, DISTCP, Hadoop, queue, YarnLeave a Comment

Posts navigation

Page 1 Page 2 Page 3 Page 4
Recent Posts
  • Sencha-Touch-2 – Sencha Touch 2, Nested XML Analysis NodeValue
  • Add a separation line and format XML content
  • Is there a norm of simplified XML subsets?
  • Look at it when you write React
  • ReactJS – Present React Redux React-Router App to add the server to the Firebase hosted by the Firebase
Categories
  • Android
  • Apache
  • Apache Kafka
  • Asp
  • Auto-Test
  • Automated Build
  • Aws
  • Bitcoin
  • Browser
  • C & C++
  • C#
  • Centos
  • Cgi
  • Character
  • Cloud Service
  • Cocos2dx
  • Cordova
  • CSS
  • Data Structure
  • Delphi
  • Design Pattern
  • Dojo
  • Dubbo
  • ELK
  • Flex
  • football
  • Game
  • Hadoop
  • Hibernate
  • HTML
  • Hybrid
  • Intel
  • IOS
  • Ipad
  • iPhone
  • Java
  • Javascript
  • Jetty
  • JQuery
  • Jsp
  • Linux
  • Load Balance
  • Lua
  • Macbook
  • Macos
  • Mathematics
  • Micro Services
  • Monitoring
  • Motherboard
  • Mysql
  • Network Hardware
  • Network Marketing
  • Nginx
  • NodeJs
  • Nosql
  • Oracle
  • Os Theory
  • Performance
  • PHP
  • Postgresql
  • Power Designer
  • React
  • Redis
  • Regexp
  • Rom
  • Rss
  • Ruby
  • Search Engines
  • Shell Script
  • Silicon Valley
  • Silverlight
  • Software Design
  • Spring
  • Sql
  • Sqlite
  • Sqlserver
  • Storage
  • Storm
  • Surface
  • SVN
  • Swift
  • System Architecture
  • Tablet
  • Uncategorized
  • Unix
  • Visual Basic
  • Visual Studio
  • Web Crawler
  • WebService
  • Windows
  • Wireless
  • XML
  • ZooKeeper
Archives
  • October 2021
  • September 2021
  • August 2021
  • May 2021
  • April 2021
  • September 2020
  • September 2019
  • August 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
© Simon Technology Blog 2025 • ThemeCountry Powered by WordPress