|
0a3508087e
|
hunter/worker: add hunter_requests gauges for stream_open_token
|
2023-08-09 02:05:25 +02:00 |
|
|
50c6d29c71
|
hunter/worker: log when deleting token
|
2023-08-08 23:41:12 +02:00 |
|
|
abf2f2467f
|
hunter/webfinger: urlencode
|
2023-08-08 22:04:41 +02:00 |
|
|
aa1d0f1009
|
begin collecting tokens
|
2023-08-08 22:04:29 +02:00 |
|
|
5839a02e55
|
hunter/worker: gauge webfinger
|
2023-08-02 01:08:20 +02:00 |
|
|
251fe68103
|
hunter/scheduler: implement updating the known_user of a known instance
|
2023-08-01 22:18:17 +02:00 |
|
|
b0d63aad28
|
hunter: remove some unwrap()
|
2023-08-01 21:51:01 +02:00 |
|
|
c53d678cab
|
hunter/scheduler: bump default intervals
|
2023-08-01 21:27:53 +02:00 |
|
|
c71dbca47a
|
hunter: try looking up webfinger with known_user
|
2023-08-01 21:26:17 +02:00 |
|
|
7c7b75537e
|
hunter: add URL in User-Agent
|
2023-04-24 19:38:44 +02:00 |
|
|
2847bdc69e
|
hunter: try out tokio-uring
|
2023-04-24 19:35:19 +02:00 |
|
|
33c910ff7a
|
hunter: redesign hosts introduction in worker to add scanning reblog mentions
|
2023-04-24 19:27:13 +02:00 |
|
|
0bef428894
|
hunter: remove unnecessary cloning
|
2023-04-24 19:21:15 +02:00 |
|
|
18de86dde2
|
hunter: avoid double lookup in Scheduler::introduce()
|
2023-04-24 18:48:31 +02:00 |
|
|
fb21cf0335
|
hunter/worker: learn hosts from reblogged accounts
|
2023-03-09 00:58:30 +01:00 |
|
|
ec368e4557
|
hunter/worker: output more stream stats
|
2023-03-09 00:56:48 +01:00 |
|
|
f6e607d6ec
|
hunter/worker: eliminate useless RwLock
|
2023-03-04 00:59:09 +01:00 |
|
|
f32ec17704
|
hunter/worker: let stream post_count increase new_post_ratio
|
2023-03-04 00:50:35 +01:00 |
|
|
9df753d1b6
|
hunter/scheduler: revert set last_fetch on dequeue() not reenqueue()
|
2023-03-04 00:50:17 +01:00 |
|
|
5f1d9862c5
|
hunter/worker: update mean_interval with stream_avg_interval if post_count > 0
|
2023-03-03 21:36:58 +01:00 |
|
|
b2a5228f98
|
hunter/worker: fix stream_avg_interval calculation
|
2023-03-03 21:24:28 +01:00 |
|
|
08e920e247
|
hunter/scheduler: fix fetch interval reporting
|
2023-03-03 21:07:44 +01:00 |
|
|
6231884d36
|
hunter: estimate stream_avg_interval
|
2023-03-03 20:49:34 +01:00 |
|
|
2f7b9a4b23
|
hunter: set last_fetch on dequeue() not reenqueue()
|
2023-03-03 20:47:14 +01:00 |
|
|
b7be2337ea
|
hunter/block_list: integrate
|
2023-01-26 00:17:13 +01:00 |
|
|
a091d60647
|
cave/live_file: add inotify
|
2023-01-25 23:30:35 +01:00 |
|
|
79fc18e5a8
|
hunter/block_list: init backed by cave/live_file
|
2023-01-23 21:04:42 +01:00 |
|
|
f2e65fd6cd
|
hunter: split into butcher
|
2023-01-22 00:05:10 +01:00 |
|
|
077feb4c6c
|
hunter/trend_setter: fix removal of tags from trend_pools
|
2022-12-30 19:51:09 +01:00 |
|
|
33d5221e12
|
hunter/main: enable reqwest tcp_keepalive
|
2022-12-29 15:30:35 +01:00 |
|
|
df50718724
|
Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19 .
|
2022-12-29 03:17:03 +01:00 |
|
|
5260090b19
|
hunter/worker: invert hunter_new_post_ratio metric
|
2022-12-27 20:34:34 +01:00 |
|
|
704b883de2
|
hunter/worker: adjust new posts log level
|
2022-12-27 19:05:53 +01:00 |
|
|
ff9c64ec1a
|
hunter: add more metrics
|
2022-12-27 19:03:09 +01:00 |
|
|
01972899ae
|
hunter/trend_setter: reduce metrics histogram facets
|
2022-12-27 03:54:09 +01:00 |
|
|
feb60d9805
|
hunter/worker: measure hunter_worker_starts
|
2022-12-26 04:30:27 +01:00 |
|
|
262ac7ad73
|
hunter/trend_setter: add metrics
|
2022-12-26 04:21:42 +01:00 |
|
|
aeec4045a0
|
hunter/worker: catch runaway metrics
|
2022-12-26 04:14:10 +01:00 |
|
|
ce3f184d04
|
hunter: add metrics for prometheus
|
2022-12-26 03:46:11 +01:00 |
|
|
f5fb098bd2
|
switch from log to tracing
|
2022-12-26 03:05:00 +01:00 |
|
|
21e670cd2c
|
hunter: remove evil hosts from redis again
|
2022-12-26 02:49:43 +01:00 |
|
|
484992b92b
|
hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts
|
2022-12-26 02:25:50 +01:00 |
|
|
0195cab965
|
hunter/scheduler: commit the fixed EVIL_DOMAINS check
|
2022-12-26 02:25:13 +01:00 |
|
|
ea0fe54106
|
hunter/scheduler: filter EVIL_DOMAINS
|
2022-12-04 03:54:42 +01:00 |
|
|
c1d2c3786d
|
hunter/main: use jemalloc
|
2022-12-03 01:47:44 +01:00 |
|
|
fed37ce56f
|
hunter/main: enable trust-dns
seems to use even more memory but perhaps we're no longer bound by
worker threads?
|
2022-12-03 01:47:07 +01:00 |
|
|
cd132a67bc
|
cave/feed: clean up with EncodedPost
|
2022-12-02 23:05:35 +01:00 |
|
|
f7ebb08274
|
cave/feed: wrap Post in EncodablePost
|
2022-12-02 22:03:38 +01:00 |
|
|
51a21d3fbc
|
hunter: Arcify host
|
2022-12-02 00:50:01 +01:00 |
|
|
69ba3ed657
|
posts_cache: use only 1 Arc
|
2022-12-02 00:30:10 +01:00 |
|