|
|
0bef428894
|
hunter: remove unnecessary cloning
|
2023-04-24 19:21:15 +02:00 |
|
|
|
18de86dde2
|
hunter: avoid double lookup in Scheduler::introduce()
|
2023-04-24 18:48:31 +02:00 |
|
|
|
fb21cf0335
|
hunter/worker: learn hosts from reblogged accounts
|
2023-03-09 00:58:30 +01:00 |
|
|
|
ec368e4557
|
hunter/worker: output more stream stats
|
2023-03-09 00:56:48 +01:00 |
|
|
|
f6e607d6ec
|
hunter/worker: eliminate useless RwLock
|
2023-03-04 00:59:09 +01:00 |
|
|
|
f32ec17704
|
hunter/worker: let stream post_count increase new_post_ratio
|
2023-03-04 00:50:35 +01:00 |
|
|
|
9df753d1b6
|
hunter/scheduler: revert set last_fetch on dequeue() not reenqueue()
|
2023-03-04 00:50:17 +01:00 |
|
|
|
5f1d9862c5
|
hunter/worker: update mean_interval with stream_avg_interval if post_count > 0
|
2023-03-03 21:36:58 +01:00 |
|
|
|
b2a5228f98
|
hunter/worker: fix stream_avg_interval calculation
|
2023-03-03 21:24:28 +01:00 |
|
|
|
08e920e247
|
hunter/scheduler: fix fetch interval reporting
|
2023-03-03 21:07:44 +01:00 |
|
|
|
6231884d36
|
hunter: estimate stream_avg_interval
|
2023-03-03 20:49:34 +01:00 |
|
|
|
2f7b9a4b23
|
hunter: set last_fetch on dequeue() not reenqueue()
|
2023-03-03 20:47:14 +01:00 |
|
|
|
b7be2337ea
|
hunter/block_list: integrate
|
2023-01-26 00:17:13 +01:00 |
|
|
|
a091d60647
|
cave/live_file: add inotify
|
2023-01-25 23:30:35 +01:00 |
|
|
|
79fc18e5a8
|
hunter/block_list: init backed by cave/live_file
|
2023-01-23 21:04:42 +01:00 |
|
|
|
f2e65fd6cd
|
hunter: split into butcher
|
2023-01-22 00:05:10 +01:00 |
|
|
|
077feb4c6c
|
hunter/trend_setter: fix removal of tags from trend_pools
|
2022-12-30 19:51:09 +01:00 |
|
|
|
33d5221e12
|
hunter/main: enable reqwest tcp_keepalive
|
2022-12-29 15:30:35 +01:00 |
|
|
|
df50718724
|
Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19.
|
2022-12-29 03:17:03 +01:00 |
|
|
|
5260090b19
|
hunter/worker: invert hunter_new_post_ratio metric
|
2022-12-27 20:34:34 +01:00 |
|
|
|
704b883de2
|
hunter/worker: adjust new posts log level
|
2022-12-27 19:05:53 +01:00 |
|
|
|
ff9c64ec1a
|
hunter: add more metrics
|
2022-12-27 19:03:09 +01:00 |
|
|
|
01972899ae
|
hunter/trend_setter: reduce metrics histogram facets
|
2022-12-27 03:54:09 +01:00 |
|
|
|
feb60d9805
|
hunter/worker: measure hunter_worker_starts
|
2022-12-26 04:30:27 +01:00 |
|
|
|
262ac7ad73
|
hunter/trend_setter: add metrics
|
2022-12-26 04:21:42 +01:00 |
|
|
|
aeec4045a0
|
hunter/worker: catch runaway metrics
|
2022-12-26 04:14:10 +01:00 |
|
|
|
ce3f184d04
|
hunter: add metrics for prometheus
|
2022-12-26 03:46:11 +01:00 |
|
|
|
f5fb098bd2
|
switch from log to tracing
|
2022-12-26 03:05:00 +01:00 |
|
|
|
21e670cd2c
|
hunter: remove evil hosts from redis again
|
2022-12-26 02:49:43 +01:00 |
|
|
|
484992b92b
|
hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts
|
2022-12-26 02:25:50 +01:00 |
|
|
|
0195cab965
|
hunter/scheduler: commit the fixed EVIL_DOMAINS check
|
2022-12-26 02:25:13 +01:00 |
|
|
|
47aa137c22
|
Cargo.toml: fix by moving optimization config to project root
|
2022-12-04 03:55:36 +01:00 |
|
|
|
ea0fe54106
|
hunter/scheduler: filter EVIL_DOMAINS
|
2022-12-04 03:54:42 +01:00 |
|
|
|
908fb9c8d3
|
*/Cargo.toml: add optimization flags
|
2022-12-03 01:51:38 +01:00 |
|
|
|
c1d2c3786d
|
hunter/main: use jemalloc
|
2022-12-03 01:47:44 +01:00 |
|
|
|
fed37ce56f
|
hunter/main: enable trust-dns
seems to use even more memory but perhaps we're no longer bound by
worker threads?
|
2022-12-03 01:47:07 +01:00 |
|
|
|
cd132a67bc
|
cave/feed: clean up with EncodedPost
|
2022-12-02 23:05:35 +01:00 |
|
|
|
f7ebb08274
|
cave/feed: wrap Post in EncodablePost
|
2022-12-02 22:03:38 +01:00 |
|
|
|
51a21d3fbc
|
hunter: Arcify host
|
2022-12-02 00:50:01 +01:00 |
|
|
|
69ba3ed657
|
posts_cache: use only 1 Arc
|
2022-12-02 00:30:10 +01:00 |
|
|
|
f03a83e9cd
|
hunter/tag_trimmer: act more gently
|
2022-11-24 19:25:03 +01:00 |
|
|
|
77997e9720
|
hunter: redisable reqwst feature rustls
|
2022-11-24 19:24:44 +01:00 |
|
|
|
00ded7dc8e
|
hunter: add posts_cache
|
2022-11-23 23:59:35 +01:00 |
|
|
|
91dcf74609
|
hunter/worker: free RobotsTxt earlier
|
2022-11-18 20:13:34 +01:00 |
|
|
|
3ccc6278d9
|
hunter/main: bump systemd::extend_timeout() for introducing hosts from redis
|
2022-11-18 17:43:35 +01:00 |
|
|
|
73b3641605
|
hunter/main: extend systemd StartTimeout
|
2022-11-15 19:02:14 +01:00 |
|
|
|
e622eace28
|
hunter/main: introduce hosts from redis only on production
|
2022-11-14 22:45:33 +01:00 |
|
|
|
4684274d6d
|
hunter/trend_setter: bump MIN_INTERVAL
|
2022-11-14 21:52:25 +01:00 |
|
|
|
d65abb82c3
|
hunter/main: reenable introducing hosts from redis
|
2022-11-14 19:30:19 +01:00 |
|
|
|
e49ae907e5
|
cave/trend_tag: switch from by_hours to hour_users algorithm
|
2022-11-14 03:14:12 +01:00 |
|
