|
|
295a7791be
|
delint
|
2024-03-27 02:49:15 +01:00 |
|
|
|
b06c0e48c5
|
delint
|
2024-03-27 02:16:27 +01:00 |
|
|
|
3a14867a75
|
update axum and reqwest dependencies to http-1.0
|
2024-03-27 02:03:49 +01:00 |
|
|
|
c567cb62e9
|
hunter/main: increase metric timeout
stream_token has low fluctuation, it was disappearing from the stats.
|
2023-10-29 20:51:04 +01:00 |
|
|
|
c4f2b1f640
|
hunter/main: limit http client redirect policy
|
2023-10-29 20:12:39 +01:00 |
|
|
|
321217563a
|
hunter/worker: filter authors by block_list
|
2023-10-18 16:37:41 +02:00 |
|
|
|
f656daf07a
|
cave/block_list: move from hunter
|
2023-10-18 02:03:41 +02:00 |
|
|
|
fe0d19fbc6
|
cave: move posts_cache from hunter
|
2023-10-12 23:28:48 +02:00 |
|
|
|
91fa0714b9
|
cave/store, cave/firehose: require redis_password_file
|
2023-10-12 21:49:47 +02:00 |
|
|
|
7df2f259d3
|
hunter/main: fix conditional compilation of scheduler hydration
|
2023-10-09 01:52:00 +02:00 |
|
|
|
bdd3fcb467
|
hunter/main: use mimalloc
|
2023-10-01 23:31:17 +02:00 |
|
|
|
aa1d0f1009
|
begin collecting tokens
|
2023-08-08 22:04:29 +02:00 |
|
|
|
c71dbca47a
|
hunter: try looking up webfinger with known_user
|
2023-08-01 21:26:17 +02:00 |
|
|
|
7c7b75537e
|
hunter: add URL in User-Agent
|
2023-04-24 19:38:44 +02:00 |
|
|
|
2847bdc69e
|
hunter: try out tokio-uring
|
2023-04-24 19:35:19 +02:00 |
|
|
|
b7be2337ea
|
hunter/block_list: integrate
|
2023-01-26 00:17:13 +01:00 |
|
|
|
79fc18e5a8
|
hunter/block_list: init backed by cave/live_file
|
2023-01-23 21:04:42 +01:00 |
|
|
|
f2e65fd6cd
|
hunter: split into butcher
|
2023-01-22 00:05:10 +01:00 |
|
|
|
33d5221e12
|
hunter/main: enable reqwest tcp_keepalive
|
2022-12-29 15:30:35 +01:00 |
|
|
|
feb60d9805
|
hunter/worker: measure hunter_worker_starts
|
2022-12-26 04:30:27 +01:00 |
|
|
|
ce3f184d04
|
hunter: add metrics for prometheus
|
2022-12-26 03:46:11 +01:00 |
|
|
|
f5fb098bd2
|
switch from log to tracing
|
2022-12-26 03:05:00 +01:00 |
|
|
|
21e670cd2c
|
hunter: remove evil hosts from redis again
|
2022-12-26 02:49:43 +01:00 |
|
|
|
484992b92b
|
hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts
|
2022-12-26 02:25:50 +01:00 |
|
|
|
c1d2c3786d
|
hunter/main: use jemalloc
|
2022-12-03 01:47:44 +01:00 |
|
|
|
fed37ce56f
|
hunter/main: enable trust-dns
seems to use even more memory but perhaps we're no longer bound by
worker threads?
|
2022-12-03 01:47:07 +01:00 |
|
|
|
00ded7dc8e
|
hunter: add posts_cache
|
2022-11-23 23:59:35 +01:00 |
|
|
|
3ccc6278d9
|
hunter/main: bump systemd::extend_timeout() for introducing hosts from redis
|
2022-11-18 17:43:35 +01:00 |
|
|
|
73b3641605
|
hunter/main: extend systemd StartTimeout
|
2022-11-15 19:02:14 +01:00 |
|
|
|
e622eace28
|
hunter/main: introduce hosts from redis only on production
|
2022-11-14 22:45:33 +01:00 |
|
|
|
d65abb82c3
|
hunter/main: reenable introducing hosts from redis
|
2022-11-14 19:30:19 +01:00 |
|
|
|
e49ae907e5
|
cave/trend_tag: switch from by_hours to hour_users algorithm
|
2022-11-14 03:14:12 +01:00 |
|
|
|
48156b640c
|
cave/store: bump max_pool_size
|
2022-11-12 02:47:21 +01:00 |
|
|
|
d35004c4d1
|
hunter/tag_timmer: add
|
2022-11-12 01:02:44 +01:00 |
|
|
|
663db47973
|
add working streaming
|
2022-11-11 22:13:33 +01:00 |
|
|
|
e620c69a32
|
hunter: refactor worker to prepare for more fetch steps
|
2022-11-11 18:08:13 +01:00 |
|
|
|
adedb40105
|
cave/store: add RedisPool
|
2022-11-10 15:22:45 +01:00 |
|
|
|
0c23fad76d
|
hunter/trend_setter: implement maintaining the pools
|
2022-11-09 18:11:02 +01:00 |
|
|
|
a98a669086
|
hunter: begin trend_setter
|
2022-11-08 00:43:46 +01:00 |
|
|
|
a5a5a10d15
|
hunter/redis_store: move into cave::store
|
2022-11-07 22:07:07 +01:00 |
|
|
|
566aecc3dd
|
hunter/main: add more systemd status
|
2022-11-07 03:30:12 +01:00 |
|
|
|
1cf7e200ab
|
hunter: rework scheduling algorithm
|
2022-11-07 00:58:28 +01:00 |
|
|
|
bd7604f639
|
cave: init
|
2022-11-05 20:51:18 +01:00 |
|
|
|
44a3d68201
|
hunter/worker: simplify error case, hardcode interval_after_error
|
2022-11-05 03:25:30 +01:00 |
|
|
|
c7a92a519d
|
store known hosts in redis only after successful fetch
|
2022-11-03 21:17:21 +01:00 |
|
|
|
98fade50f4
|
limit connections
|
2022-11-03 20:48:36 +01:00 |
|
|
|
ca66146eb3
|
save hosts to/load from redis
|
2022-11-03 18:58:37 +01:00 |
|
|
|
420d53aa61
|
notify systemd
|
2022-11-03 17:34:29 +01:00 |
|
|
|
748ccd4f59
|
use env_logger
|
2022-11-03 17:22:21 +01:00 |
|
|
|
63ee84b93c
|
move into subdir hunter/
|
2022-11-03 17:17:39 +01:00 |
|
