|
9dd6647789
|
nixos-module: allow LimitNOFILE=100000
|
2022-11-11 23:20:48 +01:00 |
|
|
663db47973
|
add working streaming
|
2022-11-11 22:13:33 +01:00 |
|
|
c473f1e03d
|
gatherer: highlight current page in langauge bar
|
2022-11-11 20:04:35 +01:00 |
|
|
6c980a60fd
|
gatherer: refine hour_scores_data period
|
2022-11-11 19:55:01 +01:00 |
|
|
0e5fab858e
|
hunter/worker: eval robot.delay
|
2022-11-11 19:21:44 +01:00 |
|
|
33c042699c
|
gatherer: remove debug output from hour_graphs.js
|
2022-11-11 19:06:50 +01:00 |
|
|
53ae6e6ba1
|
hunter/worker: refactor, prepare stream, add robots.txt support
|
2022-11-11 19:00:37 +01:00 |
|
|
e620c69a32
|
hunter: refactor worker to prepare for more fetch steps
|
2022-11-11 18:08:13 +01:00 |
|
|
51a4f7c5ea
|
make languages depend on trend pool size
|
2022-11-11 17:11:13 +01:00 |
|
|
8a06aa10d5
|
gatherer: add hour_graphs.js
|
2022-11-11 16:45:43 +01:00 |
|
|
6b9ef41bde
|
cave/trend_tag: penalize properly
|
2022-11-10 15:23:02 +01:00 |
|
|
adedb40105
|
cave/store: add RedisPool
|
2022-11-10 15:22:45 +01:00 |
|
|
9b6ecea459
|
gatherer: prettify
|
2022-11-10 14:33:20 +01:00 |
|
|
aa715aa377
|
hunter/trend_setter: keep score <= 0 out of pools
|
2022-11-10 03:28:51 +01:00 |
|
|
5848c48868
|
cave/trend_tag: limit before window to 3 * period
|
2022-11-10 03:28:20 +01:00 |
|
|
9e17aef13e
|
gatherer/main: signal systemd::ready()
|
2022-11-10 03:27:50 +01:00 |
|
|
88232868cb
|
nixos-module: add gatherer
|
2022-11-10 03:27:38 +01:00 |
|
|
f81ab8d60c
|
gatherer: show languages
|
2022-11-10 02:47:09 +01:00 |
|
|
db23cbf314
|
gatherer/trends: fix TrendAnalyzer
|
2022-11-09 19:51:59 +01:00 |
|
|
d42615b44e
|
hunter: fix debug output
|
2022-11-09 19:25:51 +01:00 |
|
|
584d7b2424
|
cave/store: delint
|
2022-11-09 19:25:28 +01:00 |
|
|
1092194bba
|
move all trend filters from gatherer to hunter
|
2022-11-09 19:25:07 +01:00 |
|
|
9a27b117a8
|
flake.nix: add packages.${system}.caveman-gatherer
|
2022-11-09 19:14:03 +01:00 |
|
|
091b01b3e3
|
cave/trend_tag: ignore spammy tags
|
2022-11-09 19:05:40 +01:00 |
|
|
e224c14c86
|
gatherer: adopt trend pools
|
2022-11-09 19:03:03 +01:00 |
|
|
0c23fad76d
|
hunter/trend_setter: implement maintaining the pools
|
2022-11-09 18:11:02 +01:00 |
|
|
a98a669086
|
hunter: begin trend_setter
|
2022-11-08 00:43:46 +01:00 |
|
|
a5a5a10d15
|
hunter/redis_store: move into cave::store
|
2022-11-07 22:07:07 +01:00 |
|
|
ce328e3041
|
gatherer: improve frontend cosmetics
|
2022-11-07 21:42:53 +01:00 |
|
|
3728fa0d5e
|
hhunter/redis_store: work around bogus language
|
2022-11-07 04:30:14 +01:00 |
|
|
e9d3c9aed0
|
hunter/scheduler: add jitter to interval on no new posts
|
2022-11-07 04:08:31 +01:00 |
|
|
566aecc3dd
|
hunter/main: add more systemd status
|
2022-11-07 03:30:12 +01:00 |
|
|
24a2b94dcd
|
hunter/redis_store: clip language to 2 chars
|
2022-11-07 03:29:53 +01:00 |
|
|
88d0abc0a0
|
hunter/redis_store: start writing language stats
|
2022-11-07 03:26:53 +01:00 |
|
|
1cf7e200ab
|
hunter: rework scheduling algorithm
|
2022-11-07 00:58:28 +01:00 |
|
|
c218cae316
|
gatherer: ignore trends from <2 hosts
|
2022-11-06 23:49:42 +01:00 |
|
|
52c0200da9
|
gatherer: add css
|
2022-11-06 23:49:17 +01:00 |
|
|
7913f6fa5f
|
hunter/worker: fetch a maximum of 40 posts
|
2022-11-06 22:30:43 +01:00 |
|
|
5174e9e235
|
gatherer: render spelling and hosts
|
2022-11-06 02:20:36 +01:00 |
|
|
23e3c689a6
|
gatherer: delint
|
2022-11-06 02:20:22 +01:00 |
|
|
44a365b572
|
gather: add webserver
|
2022-11-06 01:29:58 +01:00 |
|
|
bd7604f639
|
cave: init
|
2022-11-05 20:51:18 +01:00 |
|
|
c3039f96b6
|
gatherer: add PoC
|
2022-11-05 20:04:31 +01:00 |
|
|
6ac923f270
|
hunter/redis_store: ignore future or ancient posts
|
2022-11-05 19:45:59 +01:00 |
|
|
02f047d469
|
hunter: add more logging
|
2022-11-05 03:29:07 +01:00 |
|
|
2fdd0e079b
|
hunter/worker: don't pass host to save_post()
|
2022-11-05 03:26:34 +01:00 |
|
|
44a3d68201
|
hunter/worker: simplify error case, hardcode interval_after_error
|
2022-11-05 03:25:30 +01:00 |
|
|
36adb5f324
|
don't discard foreign posts
|
2022-11-04 15:58:03 +01:00 |
|
|
8d097e2f33
|
don't ignore foreign posts
|
2022-11-04 15:50:25 +01:00 |
|
|
36b1d688db
|
s/Post.url/Post.uri/
|
2022-11-04 15:50:00 +01:00 |
|