eson
|
36c28826ba
|
change some api
|
2020-08-12 18:18:25 +08:00 |
|
eson
|
d91e6be269
|
rename api name xml -> html
|
2020-08-12 17:42:27 +08:00 |
|
eson
|
885003bf76
|
Merge tag 'v0.5.1' into develop
v0.5.1
fix: not megre newest version
|
2020-08-12 12:25:33 +08:00 |
|
eson
|
ba95402651
|
Merge branch 'release/v0.5.1'
|
2020-08-12 12:25:10 +08:00 |
|
eson
|
c878de09ee
|
Merge branch 'feature/add-twitcasting' into develop
|
2020-08-12 12:24:53 +08:00 |
|
eson
|
671bd8f70a
|
Merge tag 'v0.5.0' into develop
v0.5.0
|
2020-08-12 12:23:44 +08:00 |
|
eson
|
2b3c7a662e
|
Merge branch 'release/v0.5.0'
|
2020-08-12 12:23:39 +08:00 |
|
eson
|
16c3ed93b7
|
finish twitcasting
|
2020-08-12 12:22:46 +08:00 |
|
eson
|
b82b4f5b77
|
finish tag slice
|
2020-08-11 18:26:17 +08:00 |
|
eson
|
23fa32b4ae
|
TODO: 重构XPath 的使用 shit
|
2020-08-07 18:10:22 +08:00 |
|
eson
|
0bff7169ec
|
Extractor upgrade
|
2020-08-05 18:49:47 +08:00 |
|
eson
|
6158976986
|
add twitcasting test
|
2020-08-04 14:13:39 +08:00 |
|
eson
|
826d15876a
|
fix windows quit
|
2020-08-04 14:12:00 +08:00 |
|
eson
|
93ec2e78a6
|
Merge tag 'v0.4.0' into develop
v0.4.0
|
2020-07-31 18:05:51 +08:00 |
|
eson
|
2161de6e33
|
Merge branch 'release/v0.4.0'
|
2020-07-31 18:05:28 +08:00 |
|
eson
|
ac47b28153
|
Merge branch 'feature/add-twitch' into develop
|
2020-07-31 18:05:06 +08:00 |
|
eson
|
0c54cbf8d8
|
完成twitch的期望功能
|
2020-07-31 18:04:10 +08:00 |
|
eson
|
ac1ab81676
|
完成twitch 数据提取入库
|
2020-07-28 18:56:27 +08:00 |
|
eson
|
1d2f2d14c5
|
1. 添加了block twitch 视频流的插件.
2. 流量减少99%
3. cpu使用率降低50%
4. 速度提高了400%
|
2020-07-27 19:30:54 +08:00 |
|
|
|
41d3763b57
|
TODO: finish extractor data
|
2020-07-27 00:35:41 +08:00 |
|
eson
|
ea650f91dc
|
TODO: twitch get all userid list
|
2020-07-24 18:48:33 +08:00 |
|
eson
|
cbdedb6795
|
twitch source 非常多, 需要把增量的架构设计好. 修改原来架构.
|
2020-07-23 18:29:56 +08:00 |
|
eson
|
6d688b8450
|
fix: libxml2 leak
|
2020-07-22 20:00:02 +08:00 |
|
eson
|
b9f2f5cf22
|
Merge tag 'v0.3.0' into develop
finish
|
2020-07-21 15:07:24 +08:00 |
|
eson
|
9c4b3eb60b
|
Merge branch 'release/v0.3.0'
|
2020-07-21 15:07:18 +08:00 |
|
eson
|
079488a2ba
|
v0.3.0版本重构. 以 主播 为目标单位.
|
2020-07-21 15:05:56 +08:00 |
|
eson
|
d7a6da287d
|
TODO: extractor 的重构.
|
2020-07-20 18:54:34 +08:00 |
|
eson
|
f0f83a9f00
|
1.最后一次数据存储结构重构.
2.数据最接近需求方.
|
2020-07-20 18:13:54 +08:00 |
|
eson
|
6369387179
|
Merge tag 'v0.2.1' into develop
测试完整
|
2020-07-17 19:21:33 +08:00 |
|
eson
|
2611e1df9f
|
Merge branch 'release/v0.2.1'
|
2020-07-17 19:21:04 +08:00 |
|
eson
|
7182da2cbe
|
fix: 时区问题. sqluri导致解析错误.
|
2020-07-17 19:20:08 +08:00 |
|
eson
|
e1040e69cd
|
1.重构命名, 简化代码, 加入build.sh
2.重构数据字段结构, 使数据合理性提高.
3.测试通过openrec获取数据完整性.
TODO: 测试时区问题.
|
2020-07-17 18:21:38 +08:00 |
|
eson
|
bb0f3845b7
|
Merge tag 'v0.2.0' into develop
openrec基本完成
|
2020-07-16 18:35:46 +08:00 |
|
eson
|
8ba6169932
|
Merge branch 'release/v0.2.0'
|
2020-07-16 18:35:30 +08:00 |
|
eson
|
93efe36d0b
|
add: 优雅停机
|
2020-07-16 18:31:13 +08:00 |
|
eson
|
fe25921f9a
|
fix: ParseDuration Method
add: store UpdateOperator
|
2020-07-16 16:22:14 +08:00 |
|
eson
|
7e3b36c7d0
|
完成解析模块示例. 数据库入库测试.
TODO: 调整程序启动停止(非暴力关闭).
|
2020-07-16 15:25:55 +08:00 |
|
eson
|
51fe6f6039
|
finish: 解析逻辑, 入库正确.
TODO: 整理代码, 让入库提取数据成为 基础库.
|
2020-07-16 11:02:30 +08:00 |
|
eson
|
13ae890171
|
TODO: 正则Regexp 获取Tags错误
|
2020-07-15 19:23:45 +08:00 |
|
eson
|
b63e180499
|
添加tags, 修改 存储结构 更加接近制直播的数据存储架构.
|
2020-07-15 18:22:40 +08:00 |
|
eson
|
75b1d9fb77
|
TODO: 完善主播表的更新方式. 存在更新最新状态时, 会被改版类似情况覆盖, 从而找不到原信息数据
|
2020-07-15 15:44:21 +08:00 |
|
eson
|
0d8b456f41
|
TODO: 解决编码问题
|
2020-07-14 19:00:34 +08:00 |
|
eson
|
ad02a5b4d9
|
TODO: workflow改进, 命名
|
2020-07-13 19:11:13 +08:00 |
|
eson
|
d034647b93
|
修改直到curl 成功.
|
2020-07-13 18:10:48 +08:00 |
|
eson
|
a305700a69
|
fix: config path error
|
2020-07-10 18:39:27 +08:00 |
|
eson
|
d258cc51d3
|
for save.
|
2020-07-10 18:31:17 +08:00 |
|
eson
|
d5151f92bf
|
1.extractor 表字段的实现.
2.存储通用包的实现.
|
2020-07-10 16:13:08 +08:00 |
|
eson
|
4af5430572
|
TODO: extractor openrec
|
2020-07-10 12:05:33 +08:00 |
|
eson
|
2e9a803645
|
完成openrec源的获取.
|
2020-07-09 17:09:46 +08:00 |
|
eson
|
a027861f5a
|
add: 更新数据ext参考例子
|
2020-07-09 11:38:51 +08:00 |
|
