[关闭]
@Arslan6and6 2016-09-03T13:26:16.000000Z 字数 825 阅读 1003

Hive学习之WordCount单词统计

第七章、大数据仓库Hive深入

  1. [beifeng@hadoop-senior hadoop-2.5.0-cdh5.3.6]$ more sort.txt 
  2. hadoop	java
  3. mapreduce	map
  4. reduce	map
  5. yarn	history
  6. hadoop	yarn
  7. yarn	java 
  8. [beifeng@hadoop-senior hadoop-2.5.0-cdh5.3.6]$ pwd
  9. /opt/modules/hadoop-2.5.0-cdh5.3.6
  11. hive (test)> create table sort (fieldname string);
  13. load data local inpath '/opt/modules/hadoop-2.5.0-cdh5.3.6/sort.txt' into table sort;
  15. hive (test)> select * from sort;
  16. OK
  17. sort.fieldname
  18. hadoop  java
  19. mapreduce   map
  20. reduce  map
  21. yarn    history
  22. hadoop  yarn
  23. yarn    java 
  25. hive (test)> create table words (word string);
  27. //将按行分割后的数据加载入 表words
  28. hive (test)> insert overwrite table words select explode(split(fieldname,'[\t]')) word from sort;
  30. hive (test)> select * from words;
  31. OK
  32. words.word
  33. hadoop
  34. java
  35. mapreduce
  36. map
  37. reduce
  38. map
  39. yarn
  40. history
  41. hadoop
  42. yarn
  43. yarn
  44. java
  46. hive (test)> select word,count(word) count  from words group by word; 
  48. word    count
  49. hadoop  2
  50. history 1
  51. java    1
  52. java    1
  53. map 2
  54. mapreduce   1
  55. reduce  1
  56. yarn    3
添加新批注
在作者公开此批注前，只有你和作者可见。
回复批注