Commit Graph

106 Commits

Author SHA1 Message Date
7df2f259d3 hunter/main: fix conditional compilation of scheduler hydration 2023-10-09 01:52:00 +02:00
bdd3fcb467 hunter/main: use mimalloc 2023-10-01 23:31:17 +02:00
93d01f4233 butcher: remove useless tag_trimmer 2023-08-11 21:00:32 +02:00
3937947f94 hunter/worker: limit token_tries 2023-08-09 02:05:53 +02:00
0a3508087e hunter/worker: add hunter_requests gauges for stream_open_token 2023-08-09 02:05:25 +02:00
50c6d29c71 hunter/worker: log when deleting token 2023-08-08 23:41:12 +02:00
abf2f2467f hunter/webfinger: urlencode 2023-08-08 22:04:41 +02:00
aa1d0f1009 begin collecting tokens 2023-08-08 22:04:29 +02:00
5839a02e55 hunter/worker: gauge webfinger 2023-08-02 01:08:20 +02:00
251fe68103 hunter/scheduler: implement updating the known_user of a known instance 2023-08-01 22:18:17 +02:00
b0d63aad28 hunter: remove some unwrap() 2023-08-01 21:51:01 +02:00
c53d678cab hunter/scheduler: bump default intervals 2023-08-01 21:27:53 +02:00
c71dbca47a hunter: try looking up webfinger with known_user 2023-08-01 21:26:17 +02:00
7c7b75537e hunter: add URL in User-Agent 2023-04-24 19:38:44 +02:00
2847bdc69e hunter: try out tokio-uring 2023-04-24 19:35:19 +02:00
33c910ff7a hunter: redesign hosts introduction in worker to add scanning reblog mentions 2023-04-24 19:27:13 +02:00
0bef428894 hunter: remove unnecessary cloning 2023-04-24 19:21:15 +02:00
18de86dde2 hunter: avoid double lookup in Scheduler::introduce() 2023-04-24 18:48:31 +02:00
fb21cf0335 hunter/worker: learn hosts from reblogged accounts 2023-03-09 00:58:30 +01:00
ec368e4557 hunter/worker: output more stream stats 2023-03-09 00:56:48 +01:00
f6e607d6ec hunter/worker: eliminate useless RwLock 2023-03-04 00:59:09 +01:00
f32ec17704 hunter/worker: let stream post_count increase new_post_ratio 2023-03-04 00:50:35 +01:00
9df753d1b6 hunter/scheduler: revert set last_fetch on dequeue() not reenqueue() 2023-03-04 00:50:17 +01:00
5f1d9862c5 hunter/worker: update mean_interval with stream_avg_interval if post_count > 0 2023-03-03 21:36:58 +01:00
b2a5228f98 hunter/worker: fix stream_avg_interval calculation 2023-03-03 21:24:28 +01:00
08e920e247 hunter/scheduler: fix fetch interval reporting 2023-03-03 21:07:44 +01:00
6231884d36 hunter: estimate stream_avg_interval 2023-03-03 20:49:34 +01:00
2f7b9a4b23 hunter: set last_fetch on dequeue() not reenqueue() 2023-03-03 20:47:14 +01:00
b7be2337ea hunter/block_list: integrate 2023-01-26 00:17:13 +01:00
a091d60647 cave/live_file: add inotify 2023-01-25 23:30:35 +01:00
79fc18e5a8 hunter/block_list: init backed by cave/live_file 2023-01-23 21:04:42 +01:00
f2e65fd6cd hunter: split into butcher 2023-01-22 00:05:10 +01:00
077feb4c6c hunter/trend_setter: fix removal of tags from trend_pools 2022-12-30 19:51:09 +01:00
33d5221e12 hunter/main: enable reqwest tcp_keepalive 2022-12-29 15:30:35 +01:00
df50718724 Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19.
2022-12-29 03:17:03 +01:00
5260090b19 hunter/worker: invert hunter_new_post_ratio metric 2022-12-27 20:34:34 +01:00
704b883de2 hunter/worker: adjust new posts log level 2022-12-27 19:05:53 +01:00
ff9c64ec1a hunter: add more metrics 2022-12-27 19:03:09 +01:00
01972899ae hunter/trend_setter: reduce metrics histogram facets 2022-12-27 03:54:09 +01:00
feb60d9805 hunter/worker: measure hunter_worker_starts 2022-12-26 04:30:27 +01:00
262ac7ad73 hunter/trend_setter: add metrics 2022-12-26 04:21:42 +01:00
aeec4045a0 hunter/worker: catch runaway metrics 2022-12-26 04:14:10 +01:00
ce3f184d04 hunter: add metrics for prometheus 2022-12-26 03:46:11 +01:00
f5fb098bd2 switch from log to tracing 2022-12-26 03:05:00 +01:00
21e670cd2c hunter: remove evil hosts from redis again 2022-12-26 02:49:43 +01:00
484992b92b hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts 2022-12-26 02:25:50 +01:00
0195cab965 hunter/scheduler: commit the fixed EVIL_DOMAINS check 2022-12-26 02:25:13 +01:00
47aa137c22 Cargo.toml: fix by moving optimization config to project root 2022-12-04 03:55:36 +01:00
ea0fe54106 hunter/scheduler: filter EVIL_DOMAINS 2022-12-04 03:54:42 +01:00
908fb9c8d3 */Cargo.toml: add optimization flags 2022-12-03 01:51:38 +01:00