MCPcopy Create free account

hub / github.com/Mydreamandreality/sparkResearch / types & classes

Types & classes55 in github.com/Mydreamandreality/sparkResearch

ClassAccumulator
Created by 張燿峰 第八章案例 累加器 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/Accumulator.java:24
ClassAddLongs
加上新进入窗口的批次元素
chapter19/src/main/java/ReduceByKeyAndWindow.java:52
ClassApplication
Created by 張燿峰 测试Avg @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/Application.java:16
ClassAttackAccumulator
Created by 張燿峰 累加器 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/AttackAccumulator.java:13
ClassBroadCastParam
Created by 張燿峰 广播变量案例 @author 孤 @date 2019/3/27 @Varsion 1.0
chapter8/src/main/java/BroadCastParam.java:19
ClassChapter4
Created by 張燿峰 Spark常见案例 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/Chapter4.java:21
ClassConnectUtil
Created by 張燿峰 Mysql连接工具 @author 孤 @date 2019/3/18 @Varsion 1.0
seclover/src/main/java/JdbcUtil/ConnectUtil.java:10
ClassConnectionPool
Created by 張燿峰 静态资源池 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/tools/ConnectionPool.java:15
ClassConstantConsumer
Created by 張燿峰 Kafka消费者参数配置 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/Constant/ConstantConsumer.java:11
ClassConstantProducer
Created by 張燿峰 Kafka生产者参数配置 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/Constant/ConstantProducer.java:10
ClassContainsError
使用显示内部类替代匿名内部类,进行函数传递
chapter3/src/main/java/spark/LogError.java:39
ClassContainsErrorDev
对 ContainsError 具体类改造,改的更加灵活
chapter3/src/main/java/spark/LogError.java:49
ClassCountByWindow
Created by 張燿峰 countByWindow @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/CountByWindow.java:14
ClassCsvFile
Created by 張燿峰 CSV文件操作 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/CsvFile.java:17
ClassCustomDataFrame
Created by 張燿峰 代码显示构造schema @author 孤 @date 2019/3/29 @Varsion 1.0
chatper11/src/main/java/CustomDataFrame.java:22
ClassDataSetApplication
Created by 張燿峰 DataSet案例 @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/dataset/DataSetApplication.java:20
ClassDataSources
Created by 張燿峰 数据源数据读取存储 @author 孤 @date 2019/4/2 @Varsion 1.0
chatper11/src/main/java/datasource/DataSources.java:20
ClassGetIp
chapter19/src/main/java/ReduceByKeyAndWindow.java:41
ClassJavaBean
Created by 張燿峰 定义攻击流量中的字段 @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/JavaBean.java:12
ClassJoin
Created by 張燿峰 inner join 查询 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/Join.java:13
ClassJoinParirRDD
Created by 張燿峰 第七章案例代码 @author 孤 @date 2019/3/21 @Varsion 1.0
chapter6/src/main/java/pair/JoinParirRDD.java:18
ClassJsonData
Created by 張燿峰 Mysql 转Json Data @author 孤 @date 2019/3/18 @Varsion 1.0
seclover/src/main/java/JosnApplication/JsonData.java:10
ClassKafkaConsumers
Created by 張燿峰 kafka消费者代码案例 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/KafkaConsumers.java:20
ClassKafkaProducers
Created by 張燿峰 kafka生产者代码案例 @author 孤 @date 2019/4/25 @Varsion 1.0
kafka-test/src/main/java/v1/KafkaProducers.java:17
ClassKafkaStreaming
Created by 張燿峰 sparkStreaming消费kafka消息,实现wordCount @author 孤 @date 2019/4/28 @Varsion 1.0
chapter21/src/main/java/v1/KafkaStreaming.java:31
ClassLoadJdbc
Created by 張燿峰 获取JDBC数据源 @author 孤 @date 2019/4/3 @Varsion 1.0
chapter13/src/main/java/LoadJdbc.java:15
ClassLogError
Created by 張燿峰 日志操作 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter3/src/main/java/spark/LogError.java:15
ClassLogTuple
chapter19/src/main/java/StateLess.java:31
ClassLombda
Created by 張燿峰 Lombda 语法测试 @author 孤 @date 2019/3/13 @Varsion 1.0
src/main/java/spark/Lombda.java:15
ClassPairRdd
Created by 張燿峰 pairRDD入门案例 @author 孤 @date 2019/3/19 @Varsion 1.0
chapter6/src/main/java/pair/PairRdd.java:25
ClassParseJson
chapter7/src/main/java/SaprkFile.java:39
ClassPerson
Created by 張燿峰 @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/dataset/Person.java:14
ClassRddAvg
Created by 張燿峰 aggregate计算AVG @author 孤 @date 2019/3/15 @Varsion 1.0
chapter4/src/main/java/spark/RddAvg.java:13
ClassReduceByKeyAndWindow
Created by 張燿峰 reduceByKeyAndWindow的代码案例 @author 孤 @date 2019/4/16 @Varsion 1.0
chapter19/src/main/java/ReduceByKeyAndWindow.java:18
ClassReduceIsKey
chapter19/src/main/java/StateLess.java:39
ClassRefiectDataFrme
Created by 張燿峰 第一种方式 反射RDD转dataframe @author 孤 @date 2019/3/29 @Varsion 1.0
chatper11/src/main/java/RefiectDataFrme.java:18
ClassSaprkFile
Created by 張燿峰 spark操作不同文件的案例 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/SaprkFile.java:22
ClassSequenceFile
Created by 張燿峰 SeqnenceFile操作案例 @author 孤 @date 2019/3/22 @Varsion 1.0
chapter7/src/main/java/SequenceFile.java:17
ClassSpamEmail
Created by 張燿峰 机器学习入门案例 过滤垃圾邮件 这 个 程 序 使 用 了 MLlib 中 的 两 个 函 数:HashingTF 与 LogisticRegressionWithSGD,前者从文本数据构建词频(term frequency)特征向量,后者 使用随机梯度下降法(Stoc
chapter23/src/main/java/v1/SpamEmail.java:29
ClassSparkApplication
Created by 張燿峰 案例测试 @author 孤 @date 2019/3/18 @Varsion 1.0
chapter5/src/main/java/spark/SparkApplication.java:18
ClassSparkApplication
Created by 張燿峰 @author 孤 @date 2019/3/01 @Varsion 1.0
src/main/java/spark/SparkApplication.java:9
ClassSparkApplication
Created by 張燿峰 第二章案例 @author 孤 @date 2019/3/15 @Varsion 1.0
chapter2/src/main/java/spark/SparkApplication.java:25
ClassSparkSqlApplication
Created by 張燿峰 sparkSQL测试案例 @author 孤 @date 2019/3/27 @Varsion 1.0
chapter9/src/main/java/SparkSqlApplication.java:16
ClassSparkStreamDemo
Created by 張燿峰 sparkStreaming入门案例 @author 孤 @date 2019/4/11 @Varsion 1.0
chapter17/src/main/java/SparkStreamDemo.java:17
ClassStateLess
Created by 張燿峰 无状态转换操作案例 @author 孤 @date 2019/4/12 @Varsion 1.0
chapter19/src/main/java/StateLess.java:27
ClassSubtractLongs
移除离开窗口的旧批次元素
chapter19/src/main/java/ReduceByKeyAndWindow.java:63
ClassTest
Created by 張燿峰 @author 孤 @date 2019/4/24 @Varsion 1.0
chatper11/src/main/java/datasource/Test.java:15
ClassTestMerge
Created by 張燿峰 测试mergeData @author 孤 @date 2019/3/25 @Varsion 1.0
chapter8/src/main/java/TestMerge.java:14
ClassWindow
Created by 張燿峰 窗口转换操作 @author 孤 @date 2019/4/15 @Varsion 1.0
chapter19/src/main/java/Window.java:15
ClassfilterData
chapter7/src/main/java/SaprkFile.java:74
Classglobal
Created by 張燿峰 创建DataSet @author 孤 @date 2019/3/28 @Varsion 1.0
chapter10/src/main/java/global.java:14
ClassoutFormat
chapter19/src/main/java/StateLess.java:93
ClassreadCsv
chapter7/src/main/java/CsvFile.java:19
ClasssequenceToConvert
chapter7/src/main/java/SequenceFile.java:27
ClasswirteJson
chapter7/src/main/java/SaprkFile.java:58