Commit Graph

53 Commits

Author SHA1 Message Date
fb21cf0335 hunter/worker: learn hosts from reblogged accounts 2023-03-09 00:58:30 +01:00
1e247b4768 butcher: implement reloadable profanity list 2023-02-24 19:39:30 +01:00
b7be2337ea hunter/block_list: integrate 2023-01-26 00:17:13 +01:00
a091d60647 cave/live_file: add inotify 2023-01-25 23:30:35 +01:00
7ddc2594a2 cave/store: remove debug output 2023-01-23 21:05:44 +01:00
3a9fef6820 cave/store: extend UNSAFE_TAGS 2023-01-23 21:05:33 +01:00
79fc18e5a8 hunter/block_list: init backed by cave/live_file 2023-01-23 21:04:42 +01:00
f2e65fd6cd hunter: split into butcher 2023-01-22 00:05:10 +01:00
aeee95fa13 cave/store: fix TAG_EXPIRE multiplication 2023-01-16 04:16:40 +01:00
6e672e95fd cave/store: extend UNSAFE_TAGS 2023-01-14 04:03:45 +01:00
b05d62db73 cave/store: extend UNSAFE_TAGS 2022-12-30 01:56:31 +01:00
39d0aa823c cave/init: replace console_subscriber with tracing_subscriber 2022-12-27 03:52:20 +01:00
f5fb098bd2 switch from log to tracing 2022-12-26 03:05:00 +01:00
21e670cd2c hunter: remove evil hosts from redis again 2022-12-26 02:49:43 +01:00
ad8080d9cf cave/store: let hosts expire 2022-12-26 02:49:22 +01:00
b6d1c0dabc cave/store: commit all UNSAFE_TAGS 2022-12-26 02:24:17 +01:00
2afcd46a99 cave/store: extend UNSAFE_TAGS 2022-12-03 00:48:37 +01:00
cd132a67bc cave/feed: clean up with EncodedPost 2022-12-02 23:05:35 +01:00
f7ebb08274 cave/feed: wrap Post in EncodablePost 2022-12-02 22:03:38 +01:00
404767d88b gatherer: show images 2022-11-29 01:51:22 +01:00
d8b7ea06fd cave/store: filter bogus image urls that contain whitespace 2022-11-25 03:06:47 +01:00
3e2efe9cf1 cave/store: gather 5 images per tag 2022-11-25 02:43:28 +01:00
6d2cc9894a cave/trend_tag: bump MIN_AFTER_MENTIONS from 3 to 5 2022-11-20 03:31:31 +01:00
90e5694202 cave/store: add COUNT 10000 to scan() 2022-11-18 17:44:01 +01:00
ee0382b15e smokestack/main: use try_send() instead of hanging send() 2022-11-17 00:09:02 +01:00
24f6c2afad gatherer: move mod firehose to cave 2022-11-16 19:12:25 +01:00
2709c192fe gatherer/main: reuse PERIODS and TREND_POOL_SIZE 2022-11-16 03:12:00 +01:00
73b3641605 hunter/main: extend systemd StartTimeout 2022-11-15 19:02:14 +01:00
a96af96c7f cave/store: make firehose deduplicated 2022-11-15 02:41:16 +01:00
f9e7189c76 gatherer/firehose: add 2022-11-15 00:45:02 +01:00
d5b5516d03 gatherer/templates/trends.html: fix hour_scores_data() to clip at 48h 2022-11-14 22:44:16 +01:00
dcafdd041a cave/trend_tag: don't scale MIN_AFTER_MENTIONS 2022-11-14 20:56:28 +01:00
5211cf1692 cave/store: fix clean_trend_tag() 2022-11-14 20:55:48 +01:00
e49ae907e5 cave/trend_tag: switch from by_hours to hour_users algorithm 2022-11-14 03:14:12 +01:00
a9f2f91a2a hunter/store: start saving users per language/hour/tag 2022-11-14 01:25:42 +01:00
48156b640c cave/store: bump max_pool_size 2022-11-12 02:47:21 +01:00
d35004c4d1 hunter/tag_timmer: add 2022-11-12 01:02:44 +01:00
663db47973 add working streaming 2022-11-11 22:13:33 +01:00
6c980a60fd gatherer: refine hour_scores_data period 2022-11-11 19:55:01 +01:00
53ae6e6ba1 hunter/worker: refactor, prepare stream, add robots.txt support 2022-11-11 19:00:37 +01:00
51a4f7c5ea make languages depend on trend pool size 2022-11-11 17:11:13 +01:00
8a06aa10d5 gatherer: add hour_graphs.js 2022-11-11 16:45:43 +01:00
6b9ef41bde cave/trend_tag: penalize properly 2022-11-10 15:23:02 +01:00
adedb40105 cave/store: add RedisPool 2022-11-10 15:22:45 +01:00
5848c48868 cave/trend_tag: limit before window to 3 * period 2022-11-10 03:28:20 +01:00
f81ab8d60c gatherer: show languages 2022-11-10 02:47:09 +01:00
584d7b2424 cave/store: delint 2022-11-09 19:25:28 +01:00
091b01b3e3 cave/trend_tag: ignore spammy tags 2022-11-09 19:05:40 +01:00
e224c14c86 gatherer: adopt trend pools 2022-11-09 19:03:03 +01:00
0c23fad76d hunter/trend_setter: implement maintaining the pools 2022-11-09 18:11:02 +01:00