小型数据分析项目
本地环境:CentOS 7 + HDFS(dfs-node01、dfs-node02)
本地环境:CentOS 7 + HDFS(dfs-node01、dfs-node02)
数据分析
数据源:gps.scv
数据字段描述: VehicleId:出租车标识符 Time:数据收集时间 Longitude:经度 Latitude:纬度 Speed:速度 Direction:方位,与正北方向夹角 PassengerState:载客情况,1为载客,0为空车
运行效果
806404129594 2010-09-02 09:22:57 118.767583 32.085087999999999 2 0 1 |
---|
806404129594 2010-09-02 09:23:09 118.767588 32.085116999999997 0 0 1 |
806404129594 2010-09-02 09:23:22 118.767633 32.085307 15 32 1 |
806404129594 2010-09-02 09:23:32 118.76846 32.085515000000001 36 78 1 |
806404129594 2010-09-02 09:23:44 118.769064 32.085492000000002 1 0 1 |
806404129594 2010-09-02 09:23:57 118.76906099999999 32.085498000000001 0 0 1 |
806404129594 2010-09-02 09:24:08 118.769058 32.085495999999999 0 0 1 |
806404129594 2010-09-02 09:24:22 118.769082 32.085566 0 0 0 |
806404129594 2010-09-02 09:24:35 118.769074 32.085554000000002 0 0 0 |
806404129594 2010-09-02 09:24:46 118.76905499999999 32.085532000000001 0 0 0 |
806404129594 2010-09-02 09:24:58 118.769035 32.085517000000003 0 0 0 |
806404129594 2010-09-02 09:25:11 118.769026 32.085509000000002 0 0 0 |
806404129594 2010-09-02 09:25:22 118.769193 32.085540000000002 19 72 0 |
806404129594 2010-09-02 09:25:33 118.769941 32.085597999999997 27 90 0 |
806404129594 2010-09-02 09:25:45 118.770561 32.085529999999999 9 108 0 |
1、统计每小时总共的独立出租车的数量以及每小时载过客的独立出租车的数量,计算其载客比 第一步:数据清洗MR
806404129594 2010-09-02 09 1 |
---|
806404129594 2010-09-02 09 1 |
806404129594 2010-09-02 09 1 |