Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Mydreamandreality/sparkResearch
/ types & classes
Types & classes
55 in github.com/Mydreamandreality/sparkResearch
⨍
Functions
89
◇
Types & classes
55
Class
Accumulator
Created by 張燿峰 第八章案例 累加器 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/Accumulator.java:24
Class
AddLongs
加上新进入窗口的批次元素
chapter19/src/main/java/ReduceByKeyAndWindow.java:52
Class
Application
Created by 張燿峰 测试Avg @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/Application.java:16
Class
AttackAccumulator
Created by 張燿峰 累加器 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/AttackAccumulator.java:13
Class
BroadCastParam
Created by 張燿峰 广播变量案例 @author 孤 @date 2019/3/27 @Varsion 1.0
chapter8/src/main/java/BroadCastParam.java:19
Class
Chapter4
Created by 張燿峰 Spark常见案例 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/Chapter4.java:21
Class
ConnectUtil
Created by 張燿峰 Mysql连接工具 @author 孤 @date 2019/3/18 @Varsion 1.0
seclover/src/main/java/JdbcUtil/ConnectUtil.java:10
Class
ConnectionPool
Created by 張燿峰 静态资源池 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/tools/ConnectionPool.java:15
Class
ConstantConsumer
Created by 張燿峰 Kafka消费者参数配置 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/Constant/ConstantConsumer.java:11
Class
ConstantProducer
Created by 張燿峰 Kafka生产者参数配置 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/Constant/ConstantProducer.java:10
Class
ContainsError
使用显示内部类替代匿名内部类,进行函数传递
chapter3/src/main/java/spark/LogError.java:39
Class
ContainsErrorDev
对 ContainsError 具体类改造,改的更加灵活
chapter3/src/main/java/spark/LogError.java:49
Class
CountByWindow
Created by 張燿峰 countByWindow @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/CountByWindow.java:14
Class
CsvFile
Created by 張燿峰 CSV文件操作 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/CsvFile.java:17
Class
CustomDataFrame
Created by 張燿峰 代码显示构造schema @author 孤 @date 2019/3/29 @Varsion 1.0
chatper11/src/main/java/CustomDataFrame.java:22
Class
DataSetApplication
Created by 張燿峰 DataSet案例 @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/dataset/DataSetApplication.java:20
Class
DataSources
Created by 張燿峰 数据源数据读取存储 @author 孤 @date 2019/4/2 @Varsion 1.0
chatper11/src/main/java/datasource/DataSources.java:20
Class
GetIp
chapter19/src/main/java/ReduceByKeyAndWindow.java:41
Class
JavaBean
Created by 張燿峰 定义攻击流量中的字段 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/JavaBean.java:12
Class
Join
Created by 張燿峰 inner join 查询 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/Join.java:13
Class
JoinParirRDD
Created by 張燿峰 第七章案例代码 @author 孤 @date 2019/3/21 @Varsion 1.0
chapter6/src/main/java/pair/JoinParirRDD.java:18
Class
JsonData
Created by 張燿峰 Mysql 转Json Data @author 孤 @date 2019/3/18 @Varsion 1.0
seclover/src/main/java/JosnApplication/JsonData.java:10
Class
KafkaConsumers
Created by 張燿峰 kafka消费者代码案例 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/KafkaConsumers.java:20
Class
KafkaProducers
Created by 張燿峰 kafka生产者代码案例 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/KafkaProducers.java:17
Class
KafkaStreaming
Created by 張燿峰 sparkStreaming消费kafka消息,实现wordCount @author 孤 @date 2019/4/28 @Varsion 1.0
chapter21/src/main/java/v1/KafkaStreaming.java:31
Class
LoadJdbc
Created by 張燿峰 获取JDBC数据源 @author 孤 @date 2019/4/3 @Varsion 1.0
chapter13/src/main/java/LoadJdbc.java:15
Class
LogError
Created by 張燿峰 日志操作 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter3/src/main/java/spark/LogError.java:15
Class
LogTuple
chapter19/src/main/java/StateLess.java:31
Class
Lombda
Created by 張燿峰 Lombda 语法测试 @author 孤 @date 2019/3/13 @Varsion 1.0
src/main/java/spark/Lombda.java:15
Class
PairRdd
Created by 張燿峰 pairRDD入门案例 @author 孤 @date 2019/3/19 @Varsion 1.0
chapter6/src/main/java/pair/PairRdd.java:25
Class
ParseJson
chapter7/src/main/java/SaprkFile.java:39
Class
Person
Created by 張燿峰 @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/dataset/Person.java:14
Class
RddAvg
Created by 張燿峰 aggregate计算AVG @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/RddAvg.java:13
Class
ReduceByKeyAndWindow
Created by 張燿峰 reduceByKeyAndWindow的代码案例 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/ReduceByKeyAndWindow.java:18
Class
ReduceIsKey
chapter19/src/main/java/StateLess.java:39
Class
RefiectDataFrme
Created by 張燿峰 第一种方式 反射RDD转dataframe @author 孤 @date 2019/3/29 @Varsion 1.0
chatper11/src/main/java/RefiectDataFrme.java:18
Class
SaprkFile
Created by 張燿峰 spark操作不同文件的案例 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/SaprkFile.java:22
Class
SequenceFile
Created by 張燿峰 SeqnenceFile操作案例 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/SequenceFile.java:17
Class
SpamEmail
Created by 張燿峰 机器学习入门案例 过滤垃圾邮件 这 个 程 序 使 用 了 MLlib 中 的 两 个 函 数:HashingTF 与 LogisticRegressionWithSGD,前者从文本数据构建词频(term frequency)特征向量,后者 使用随机梯度下降法(Stoc
chapter23/src/main/java/v1/SpamEmail.java:29
Class
SparkApplication
Created by 張燿峰 案例测试 @author 孤 @date 2019/3/18 @Varsion 1.0
chapter5/src/main/java/spark/SparkApplication.java:18
Class
SparkApplication
Created by 張燿峰 @author 孤 @date 2019/3/01 @Varsion 1.0
src/main/java/spark/SparkApplication.java:9
Class
SparkApplication
Created by 張燿峰 第二章案例 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter2/src/main/java/spark/SparkApplication.java:25
Class
SparkSqlApplication
Created by 張燿峰 sparkSQL测试案例 @author 孤 @date 2019/3/27 @Varsion 1.0
chapter9/src/main/java/SparkSqlApplication.java:16
Class
SparkStreamDemo
Created by 張燿峰 sparkStreaming入门案例 @author 孤 @date 2019/4/11 @Varsion 1.0
chapter17/src/main/java/SparkStreamDemo.java:17
Class
StateLess
Created by 張燿峰 无状态转换操作案例 @author 孤 @date 2019/4/12 @Varsion 1.0
chapter19/src/main/java/StateLess.java:27
Class
SubtractLongs
移除离开窗口的旧批次元素
chapter19/src/main/java/ReduceByKeyAndWindow.java:63
Class
Test
Created by 張燿峰 @author 孤 @date 2019/4/24 @Varsion 1.0
chatper11/src/main/java/datasource/Test.java:15
Class
TestMerge
Created by 張燿峰 测试mergeData @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/TestMerge.java:14
Class
Window
Created by 張燿峰 窗口转换操作 @author 孤 @date 2019/4/15 @Varsion 1.0
chapter19/src/main/java/Window.java:15
Class
filterData
chapter7/src/main/java/SaprkFile.java:74
Class
global
Created by 張燿峰 创建DataSet @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/global.java:14
Class
outFormat
chapter19/src/main/java/StateLess.java:93
Class
readCsv
chapter7/src/main/java/CsvFile.java:19
Class
sequenceToConvert
chapter7/src/main/java/SequenceFile.java:27
Class
wirteJson
chapter7/src/main/java/SaprkFile.java:58