installing and running beeline client


I work with a Hortonworks HDP 2.5 distro of Big Data hadoop/hiveserver2. I have been wondering for sometime now what it would take to run beeline client on another machine to connect to Hive or Knox.

After some work, I managed to get beeline client running with a minimal set of jar files on another machine outside of the cluster. The crucial bit was identifying the set of jar files involved using the jvm option: -verbose:class

After collecting the necessary jar files, beeline can be started using a java commandline.

java -Xmx1024m -classpath apache-log4j-extras-1.2.17.jar:avatica-1.8.0.2.5.0.0-1245.jar:calcite-core-1.2.0.2.5.0.0-1245.jar:calcite-linq4j-1.2.0.2.5.0.0-1245.jar:commons-cli-1.2.jar:commons-codec-1.4.jar:commons-collections-3.2.2.jar:commons-configuration-1.6.jar:commons-lang-2.6.jar:commons-logging-1.1.3.jar:curator-client-2.6.0.jar:curator-framework-2.6.0.jar:derby-10.10.2.0.jar:guava-14.0.1.jar:hadoop-annotations-2.7.3.2.5.0.0-1245.jar:hadoop-auth-2.7.3.2.5.0.0-1245.jar:hadoop-common-2.7.3.2.5.0.0-1245.jar:hadoop-mapreduce-client-core-2.7.3.2.5.0.0-1245.jar:hive-beeline-1.2.1000.2.5.0.0-1245.jar:hive-exec-1.2.1000.2.5.0.0-1245.jar:hive-jdbc-1.2.1000.2.5.0.0-1245.jar:hive-jdbc-1.2.1000.2.5.0.0-1245-standalone.jar:jce.jar:jline-2.12.jar:jsse.jar:log4j-1.2.16.jar:rt.jar:slf4j-log4j12-1.7.10.jar:sunec.jar:sunjce_provider.jar:super-csv-2.2.0.jar:xercesImpl-2.9.1.jar -Dhdp.version=2.5.0.0-1245 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.0.0-1245  -Dhadoop.log.dir=/home/userid -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/userid -Dhadoop.id.str=userid -Dhadoop.root.logger=INFO,console -Djava.library.path=:/home/userid -Dhadoop.policy.file=hadoop-policy.xml  -Djava.net.preferIPv4Stack=true -Djava.util.logging.config.file=/home/userid/parquet-logging.properties -Dlog4j.configuration=beeline-log4j.properties -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /home/userid/hive-beeline-1.2.1000.2.5.0.0-1245.jar org.apache.hive.beeline.BeeLine -n userid -p pass -u "jdbc:hive2://knox.company.com:8000/;ssl=true;transportMode=http;httpPath=gateway/tdcprd/hive"

There was no need to install beeline or any hadoop app.

Java 8 JRE is required.

Advertisements

Studio condo for rent in Makati


This compact studio has:

– Newly fitted furniture and appliances
– Double bed
– Has DSL Internet wifi, 5Mpbs
– Full automatic washer and dryer

Features and amenities
– Swimming pool
– Function room
– Fitness center
– Roof garden

Salcedo Square is located on L.P. Leviste Street in the heart of Salcedo Village’s quieter side. The village is dotted with cozy cafés, food centers and well-landscaped parks that on weekends become either the joggers’ haven or Makati’s biggest weekend food-and-flea market. Centrally located, Salcedo Square is a stone’s throw away from Makati’s biggest malls:  Greenbelt and Glorietta, as well as the Ayala Triangle Park.

Salcedo square is near:
– Convergys – 1 km
– Phil. Stock Exchange – 2 km
– RCBC Plaza – 500 meters
– Makati Medical Center – 1.3 km
– MIT Makati -1.5 km
– AIMS – 2.8 km
– Ateneo Professional School – 800 meters
– Salcedo Village Velasquez Park – 400 meters
– Makati Sport Club 200 meters
– Makati Central Fire Station – 1.5 km
– Makati Central Post Office – 1.6 km
– Greenbelt – 2 km
– Glorietta – 2 km
– SM, Landmark, Rustan’s – 2.5 km

Building Features
– Well appointed air-conditioned lobby
– Powerful standby generator capable of operating all major appliances
– Full time building administrator and in-house building maintenance group
– Round the clock security services
– Two(2) Passenger Elevators
– One (1) Service Elevator
– Fully Automated Fire & Smoke Detection System
– Water Reservoir and Fire Reserves
– Centralized Garbage Depository
For more info/viewing: pbvillaflores@gmail.com
mobile: 09175882040 (Fatima)
viber: +61497814648

Posted 2017-04-30

Powerdirect vs Powershop


I just recently changed energy service providers from Powershop to Powerdirect on recommendation from iSelect. After getting my first Powerdirect bill, it does look like the shift has been a positive change.

I compute a dollar to kwh usage ratio of 0.2379 for powerdirect using the pay on time 37% discount.

The same ratio is 0.261019 for powershop.

 

Gold Coast 2017-04


 

  1. The groupon for Sifu worked out really great for our large group. Food was good and they gave us a private room. Parking was free at Crowne Hotel.
  2. Car rental with Jucy. Got a Toyota Estima/Previa 8 seater for $58 per day. Found them on airportrentals.com
  3. Marriott is situated 1km away from the central area of Elkhorn – Chevron Rennaisance.
  4. Holoverse was nice and interesting experience. Groupon voucher had free popcorn?
  5. Could have spent more time at Seaworld. Raisa does not like.
  6. Using uber for 6 people did not work. Even with uber XL the Prado that came to pickup can only fit 4.
  7. Got $20 discount at Marriott Citrique breakfast.
  8. Can get photos at movieworld if you scan barcode at end of some rides.
  9. Paradise country was not very interesting. Seaworld would probably have been better choice in the few days we had in gold coast.
  10. Car needs to be returned by 4:30pm to avail of shuttle. Takes an hour to get to Coolangata.
  11. I called my internet service provider to temporarily suspend my service. Got a bit off my bill as a result.
  12. Lost a pair of small foldable scissors at airport security. They already survived a couple of international flights.