Commit Graph

119 Commits

Author SHA1 Message Date
Astro 295a7791be delint 2024-03-27 02:49:15 +01:00
Astro b06c0e48c5 delint 2024-03-27 02:16:27 +01:00
Astro 3a14867a75 update axum and reqwest dependencies to http-1.0 2024-03-27 02:03:49 +01:00
Astro 03968b9cbb hunter/worker: use url not uri as key (same as in activitypub) 2023-11-10 23:33:01 +01:00
Astro d23bb61cb6 hunter/worker: log with stats_key to differentiate "stream_token" 2023-10-30 00:36:01 +01:00
Astro c567cb62e9 hunter/main: increase metric timeout
stream_token has low fluctuation, it was disappearing from the stats.
2023-10-29 20:51:04 +01:00
Astro c4f2b1f640 hunter/main: limit http client redirect policy 2023-10-29 20:12:39 +01:00
Astro 321217563a hunter/worker: filter authors by block_list 2023-10-18 16:37:41 +02:00
Astro f656daf07a cave/block_list: move from hunter 2023-10-18 02:03:41 +02:00
Astro 2f66958a6a hunter/worker: distinguish between stream+stream-token for stats 2023-10-17 16:03:45 +02:00
Astro fe0d19fbc6 cave: move posts_cache from hunter 2023-10-12 23:28:48 +02:00
Astro 91fa0714b9 cave/store, cave/firehose: require redis_password_file 2023-10-12 21:49:47 +02:00
Astro d9363e63e2 */Cargo.toml: remove dead lines 2023-10-12 21:04:19 +02:00
Astro 7df2f259d3 hunter/main: fix conditional compilation of scheduler hydration 2023-10-09 01:52:00 +02:00
Astro bdd3fcb467 hunter/main: use mimalloc 2023-10-01 23:31:17 +02:00
Astro 93d01f4233 butcher: remove useless tag_trimmer 2023-08-11 21:00:32 +02:00
Astro 3937947f94 hunter/worker: limit token_tries 2023-08-09 02:05:53 +02:00
Astro 0a3508087e hunter/worker: add hunter_requests gauges for stream_open_token 2023-08-09 02:05:25 +02:00
Astro 50c6d29c71 hunter/worker: log when deleting token 2023-08-08 23:41:12 +02:00
Astro abf2f2467f hunter/webfinger: urlencode 2023-08-08 22:04:41 +02:00
Astro aa1d0f1009 begin collecting tokens 2023-08-08 22:04:29 +02:00
Astro 5839a02e55 hunter/worker: gauge webfinger 2023-08-02 01:08:20 +02:00
Astro 251fe68103 hunter/scheduler: implement updating the known_user of a known instance 2023-08-01 22:18:17 +02:00
Astro b0d63aad28 hunter: remove some unwrap() 2023-08-01 21:51:01 +02:00
Astro c53d678cab hunter/scheduler: bump default intervals 2023-08-01 21:27:53 +02:00
Astro c71dbca47a hunter: try looking up webfinger with known_user 2023-08-01 21:26:17 +02:00
Astro 7c7b75537e hunter: add URL in User-Agent 2023-04-24 19:38:44 +02:00
Astro 2847bdc69e hunter: try out tokio-uring 2023-04-24 19:35:19 +02:00
Astro 33c910ff7a hunter: redesign hosts introduction in worker to add scanning reblog mentions 2023-04-24 19:27:13 +02:00
Astro 0bef428894 hunter: remove unnecessary cloning 2023-04-24 19:21:15 +02:00
Astro 18de86dde2 hunter: avoid double lookup in Scheduler::introduce() 2023-04-24 18:48:31 +02:00
Astro fb21cf0335 hunter/worker: learn hosts from reblogged accounts 2023-03-09 00:58:30 +01:00
Astro ec368e4557 hunter/worker: output more stream stats 2023-03-09 00:56:48 +01:00
Astro f6e607d6ec hunter/worker: eliminate useless RwLock 2023-03-04 00:59:09 +01:00
Astro f32ec17704 hunter/worker: let stream post_count increase new_post_ratio 2023-03-04 00:50:35 +01:00
Astro 9df753d1b6 hunter/scheduler: revert set last_fetch on dequeue() not reenqueue() 2023-03-04 00:50:17 +01:00
Astro 5f1d9862c5 hunter/worker: update mean_interval with stream_avg_interval if post_count > 0 2023-03-03 21:36:58 +01:00
Astro b2a5228f98 hunter/worker: fix stream_avg_interval calculation 2023-03-03 21:24:28 +01:00
Astro 08e920e247 hunter/scheduler: fix fetch interval reporting 2023-03-03 21:07:44 +01:00
Astro 6231884d36 hunter: estimate stream_avg_interval 2023-03-03 20:49:34 +01:00
Astro 2f7b9a4b23 hunter: set last_fetch on dequeue() not reenqueue() 2023-03-03 20:47:14 +01:00
Astro b7be2337ea hunter/block_list: integrate 2023-01-26 00:17:13 +01:00
Astro a091d60647 cave/live_file: add inotify 2023-01-25 23:30:35 +01:00
Astro 79fc18e5a8 hunter/block_list: init backed by cave/live_file 2023-01-23 21:04:42 +01:00
Astro f2e65fd6cd hunter: split into butcher 2023-01-22 00:05:10 +01:00
Astro 077feb4c6c hunter/trend_setter: fix removal of tags from trend_pools 2022-12-30 19:51:09 +01:00
Astro 33d5221e12 hunter/main: enable reqwest tcp_keepalive 2022-12-29 15:30:35 +01:00
Astro df50718724 Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19.
2022-12-29 03:17:03 +01:00
Astro 5260090b19 hunter/worker: invert hunter_new_post_ratio metric 2022-12-27 20:34:34 +01:00
Astro 704b883de2 hunter/worker: adjust new posts log level 2022-12-27 19:05:53 +01:00