I work with a Hortonworks HDP 2.5 distro of Big Data hadoop/hiveserver2. I have been wondering for sometime now what it would take to run beeline client on another machine to connect to Hive or Knox.
After some work, I managed to get beeline client running with a minimal set of jar files on another machine outside of the cluster. The crucial bit was identifying the set of jar files involved using the jvm option: -verbose:class
After collecting the necessary jar files, beeline can be started using a java commandline.
java -Xmx1024m -classpath apache-log4j-extras-1.2.17.jar:avatica-220.127.116.11.5.0.0-1245.jar:calcite-core-18.104.22.168.5.0.0-1245.jar:calcite-linq4j-22.214.171.124.5.0.0-1245.jar:commons-cli-1.2.jar:commons-codec-1.4.jar:commons-collections-3.2.2.jar:commons-configuration-1.6.jar:commons-lang-2.6.jar:commons-logging-1.1.3.jar:curator-client-2.6.0.jar:curator-framework-2.6.0.jar:derby-10.10.2.0.jar:guava-14.0.1.jar:hadoop-annotations-126.96.36.199.5.0.0-1245.jar:hadoop-auth-188.8.131.52.5.0.0-1245.jar:hadoop-common-184.108.40.206.5.0.0-1245.jar:hadoop-mapreduce-client-core-220.127.116.11.5.0.0-1245.jar:hive-beeline-1.2.1000.2.5.0.0-1245.jar:hive-exec-1.2.1000.2.5.0.0-1245.jar:hive-jdbc-1.2.1000.2.5.0.0-1245.jar:hive-jdbc-1.2.1000.2.5.0.0-1245-standalone.jar:jce.jar:jline-2.12.jar:jsse.jar:log4j-1.2.16.jar:rt.jar:slf4j-log4j12-1.7.10.jar:sunec.jar:sunjce_provider.jar:super-csv-2.2.0.jar:xercesImpl-2.9.1.jar -Dhdp.version=18.104.22.168-1245 -Djava.net.preferIPv4Stack=true -Dhdp.version=22.214.171.124-1245 -Dhadoop.log.dir=/home/userid -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/userid -Dhadoop.id.str=userid -Dhadoop.root.logger=INFO,console -Djava.library.path=:/home/userid -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.util.logging.config.file=/home/userid/parquet-logging.properties -Dlog4j.configuration=beeline-log4j.properties -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /home/userid/hive-beeline-1.2.1000.2.5.0.0-1245.jar org.apache.hive.beeline.BeeLine -n userid -p pass -u "jdbc:hive2://knox.company.com:8000/;ssl=true;transportMode=http;httpPath=gateway/tdcprd/hive"
There was no need to install beeline or any hadoop app.
Java 8 JRE is required.
This compact studio has:
– Newly fitted furniture and appliances
– Double bed
– Has DSL Internet wifi, 5Mpbs
– Full automatic washer and dryer
Features and amenities
– Swimming pool
– Function room
– Fitness center
– Roof garden
Salcedo Square is located on L.P. Leviste Street in the heart of Salcedo Village’s quieter side. The village is dotted with cozy cafés, food centers and well-landscaped parks that on weekends become either the joggers’ haven or Makati’s biggest weekend food-and-flea market. Centrally located, Salcedo Square is a stone’s throw away from Makati’s biggest malls: Greenbelt and Glorietta, as well as the Ayala Triangle Park.
Salcedo square is near:
– Convergys – 1 km
– Phil. Stock Exchange – 2 km
– RCBC Plaza – 500 meters
– Makati Medical Center – 1.3 km
– MIT Makati -1.5 km
– AIMS – 2.8 km
– Ateneo Professional School – 800 meters
– Salcedo Village Velasquez Park – 400 meters
– Makati Sport Club 200 meters
– Makati Central Fire Station – 1.5 km
– Makati Central Post Office – 1.6 km
– Greenbelt – 2 km
– Glorietta – 2 km
– SM, Landmark, Rustan’s – 2.5 km
– Well appointed air-conditioned lobby
– Powerful standby generator capable of operating all major appliances
– Full time building administrator and in-house building maintenance group
– Round the clock security services
– Two(2) Passenger Elevators
– One (1) Service Elevator
– Fully Automated Fire & Smoke Detection System
– Water Reservoir and Fire Reserves
– Centralized Garbage Depository
For more info/viewing: email@example.com
mobile: 09175882040 (Fatima)
4 Bedroom Salcedo Village Makati Condominium For Rent
This is a large 4 bedroom apartment inside Salcedo Village with 240 sqm floor space. The place has been recently renovated and features:
– toilets: 5.5
– parking: 2
– floor area: 240 sqm
– 24 hour security
– water heater
– wireless internet
– cable TV
– fitness gym
– swimming pool, 25m lap and kids pool
– party/function lounge
– in-house maintenance
– floor to celing glass windows with wide open views of the city
– six passenger lifts
– two service lifts
You will have access to a 4 bedroom condo apartment with excellent panoramic views of the Makati skyline, covered car parking as well as all amenities of the building, including a 25m lap pool, kids pool, jacuzzi, newly renovated gym, sauna and play area.
Infinity pool and children’s pool with jacuzzi
stand-by power generators
Everything you’ll ever need is so near. The Saturday market at Salcedo Velasquez Park is just a corner turn away. The are plenty of restaurants and cafes nearby. BPI, BDO, Citibank, Metrobank and HSBC are also very close. Hospitals, schools, The Glorietta and Greenbelt malls are just 10 minutes away to drive or walk.
For more info/viewing:
mobile: 09175992040 (Fatima)
I just recently changed energy service providers from Powershop to Powerdirect on recommendation from iSelect. After getting my first Powerdirect bill, it does look like the shift has been a positive change.
I compute a dollar to kwh usage ratio of 0.2379 for powerdirect using the pay on time 37% discount.
The same ratio is 0.261019 for powershop.
The weird things that Meralco does:
– makes it very hard to transfer account names, such as from developer to property owner
– blocks people making online payments when a day or more late. Do they not want to collect/receive payments in these circumstances anyway?
The weird things that PLDT do:
– makes it very hard to request an account disconnection: need to go to a PLDT business office, when the transaction could alternatively be handled over the phone. Don’t they know how to authenticate people over the phone?
The weird things that BPI do:
– Everyday their BPI express online goes offline early in the morning. It also goes offline at random times during the day.
– BPI credit cards cannot be paid from other banks online. Most other credit cards are possible to pay online via any bank.
– Charges a fee for inward local remit from another bank
The weird things Philippine banks do other than citibank:
– make it hard to do local interbank fund transfers which is very free, simple and easy to do in many other countries.
– it is not possible to choose currency when booking a flight using the website but if you call to make the booking they can.
– they make it really difficult to do simple funds transfers. Even for transfers within own account.
- search automatically defaults to text under the cursor
Some banks demonstrate behaviour that I find very odd. These are peculiar security measures that some creative security bright sparks must have thought of.
I think there is an important role for information security professionals to play, but sometimes they overdo it, or don’t seem to think through practical consquences thoroughly.
Its when banks do unique things in their process, is probably when common sense alarm bells should go off. Here are soem examples.
1. Standard chartered PH requires a mobile pin (which they call an eTAC code) even for internal transfers. And its a very long code. 10 digits
2. Metrobank PH – on most pages, copy pasting is disallowed. Even for enrolling credit card numbers for payments.
3. HSBC US blocks online internet transactions on debit cards and requires the customer to call back customer service/security department.
– customer service is only available to receive calls 9am to 5pm
– if you happen to be elsewhere around the world at the time, calling customer service may require an international call.
– HSBC US claim they have a collect call service but it doesn’t work 99% of the time
– the combination of having to call during working hours of customer service, and having to make an international call probably should have set off usability/practicality alarm bells
3. Citibank’s internet banking messaging system disallows most symbols and punctuations.
– the reply function will include original text, but the system will complain if you hit send because the system crafted original text portion has characters that it does not like
– the message is limited to only a certain number of characters, so often a message trail cannot be maintained
– the system does not store sent messages
– the system does not help the user with an indication of what the invalid character(s) are
These are just some fails I have encountered in bank security policy/processes. Have you had similar experiences?