Load data from CSV into HIVE table using HUE browser


It may be little tricky to load the data from a CSV file into a HIVE table.

Here is a quick command that can be triggered from HUE editor.

Steps:
1. Upload your CSV file that contains column data only (no headers) into use case directory or application directory in HDFS
2. Run the following command in the HIVE data broswer
LOAD DATA  INPATH "/data/applications/appname/table_test_data/testdata.csv" OVERWRITE INTO TABLE testschema.tablename;
3. This will overwrite all the contents in the table with the data from csv file. so existing data in the table will be lost

Make sure the table is already created in the HIVE. You can create the table as follows:

CREATE TABLE tablename(· 
strt_tstmp string,
end_tstmp string,
stts_cd int,
)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' · 
STORED AS TEXTFILE 

Comments

Post a Comment

Popular posts from this blog

Gitlab change project visibility from private to internal

Apparently there is no clicable option in the GITlab portal to change the project visibility from private to internal or to public once that is set at the time of creation. In order to do this, you will have to add "/edit" string to the end of your repo URL and it will show the setting page. The "Permissions" section can be expanded to change the visibility and click "Save Changes" to get your changes reflected. Hope this helps.
Read more

Setting property 'keystoreFile' did not find a matching property. No Certificate file specified or invalid file format

I encountered this weird exception on X server even after configuring the Tomcat  configuration file properly same as i did for other server  Y where it is working fine. Solution is mentioned after the exception log: May 24, 2011 5:23:45 PM org.apache.catalina.startup.SetAllPropertiesRule begin WARNING: [SetAllPropertiesRule]{Server/Service/Connector} Setting property 'keystoreFile' to 'C:\Program Files\Java\jdk1.6.0_25\keystore\.keystore' did not find a matching property. May 24, 2011 5:23:45 PM org.apache.catalina.startup.SetAllPropertiesRule begin WARNING: [SetAllPropertiesRule]{Server/Service/Connector} Setting property 'keystorePass' to 'changeit' did not find a matching property. May 24, 2011 5:23:45 PM org.apache.catalina.startup.SetAllPropertiesRule begin WARNING: [SetAllPropertiesRule]{Server/Service/Connector} Setting property 'clientAuth' to 'false' did not find a matching property. May 24, 2011 5:23:46 PM org.apache.coyote.h...
Read more