Commit Graph

233 Commits

Author SHA1 Message Date
934aa1461a gatherer/http_server: add metrics 2022-12-30 02:59:09 +01:00
b05d62db73 cave/store: extend UNSAFE_TAGS 2022-12-30 01:56:31 +01:00
1995fec968 gatherer/request_mux: eliminate 2022-12-30 01:56:20 +01:00
e806e671cd gatherer/request_mux: panic on REQUEST_TIMEOUT 2022-12-29 20:34:04 +01:00
31f5836e8a gatherer/main: parallelize images queries 2022-12-29 20:28:39 +01:00
5f708a38c1 gatherer/main: parallelize query 2022-12-29 20:12:05 +01:00
33d5221e12 hunter/main: enable reqwest tcp_keepalive 2022-12-29 15:30:35 +01:00
df50718724 Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19.
2022-12-29 03:17:03 +01:00
5260090b19 hunter/worker: invert hunter_new_post_ratio metric 2022-12-27 20:34:34 +01:00
704b883de2 hunter/worker: adjust new posts log level 2022-12-27 19:05:53 +01:00
ff9c64ec1a hunter: add more metrics 2022-12-27 19:03:09 +01:00
01972899ae hunter/trend_setter: reduce metrics histogram facets 2022-12-27 03:54:09 +01:00
39d0aa823c cave/init: replace console_subscriber with tracing_subscriber 2022-12-27 03:52:20 +01:00
feb60d9805 hunter/worker: measure hunter_worker_starts 2022-12-26 04:30:27 +01:00
262ac7ad73 hunter/trend_setter: add metrics 2022-12-26 04:21:42 +01:00
aeec4045a0 hunter/worker: catch runaway metrics 2022-12-26 04:14:10 +01:00
3759779903 nixos-module: lift LimitRSS for caveman-hunter a bit 2022-12-26 03:50:18 +01:00
ce3f184d04 hunter: add metrics for prometheus 2022-12-26 03:46:11 +01:00
f5fb098bd2 switch from log to tracing 2022-12-26 03:05:00 +01:00
66a3deb6b2 gatherer/templates/html: update me 2022-12-26 02:52:07 +01:00
21e670cd2c hunter: remove evil hosts from redis again 2022-12-26 02:49:43 +01:00
ad8080d9cf cave/store: let hosts expire 2022-12-26 02:49:22 +01:00
232a5adabd gather/tag_images.js: add image alt 2022-12-26 02:26:22 +01:00
484992b92b hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts 2022-12-26 02:25:50 +01:00
0195cab965 hunter/scheduler: commit the fixed EVIL_DOMAINS check 2022-12-26 02:25:13 +01:00
b6d1c0dabc cave/store: commit all UNSAFE_TAGS 2022-12-26 02:24:17 +01:00
a0b7ae8b3b cargo update 2022-12-26 02:23:58 +01:00
fe5fb87819 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/bba229a06ca03938a1abd4ce6361bf9bf4f651cd' (2022-11-30)
  → 'github:nix-community/fenix/9049ab18f824a092b3c74dae9f690681c0a39dfa' (2022-12-25)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/398a71affb05aeeea1991044ec9ca1229e68f0f3' (2022-11-29)
  → 'github:rust-lang/rust-analyzer/1927c2e1d8d222656cae7051cdd924aa44428622' (2022-12-24)
• Updated input 'naersk':
    'github:nmattia/naersk/6944160c19cb591eb85bbf9b2f2768a935623ed3' (2022-09-03)
  → 'github:nmattia/naersk/d998160d6a076cfe8f9741e56aeec7e267e3e114' (2022-12-15)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/227de2b3bbec142f912c09d5e8a1b4e778aa54fb' (2022-11-30)
  → 'github:NixOS/nixpkgs/aac1f0b25e6b04afad8e05dec5828f5c02398bd1' (2022-12-25)
2022-12-26 02:15:26 +01:00
47aa137c22 Cargo.toml: fix by moving optimization config to project root 2022-12-04 03:55:36 +01:00
ea0fe54106 hunter/scheduler: filter EVIL_DOMAINS 2022-12-04 03:54:42 +01:00
908fb9c8d3 */Cargo.toml: add optimization flags 2022-12-03 01:51:38 +01:00
c1d2c3786d hunter/main: use jemalloc 2022-12-03 01:47:44 +01:00
fed37ce56f hunter/main: enable trust-dns
seems to use even more memory but perhaps we're no longer bound by
worker threads?
2022-12-03 01:47:07 +01:00
2afcd46a99 cave/store: extend UNSAFE_TAGS 2022-12-03 00:48:37 +01:00
cd132a67bc cave/feed: clean up with EncodedPost 2022-12-02 23:05:35 +01:00
470012a005 gatherer/assets/hour_graph.js: round curves for relevant period 2022-12-02 22:23:57 +01:00
f7ebb08274 cave/feed: wrap Post in EncodablePost 2022-12-02 22:03:38 +01:00
51a21d3fbc hunter: Arcify host 2022-12-02 00:50:01 +01:00
69ba3ed657 posts_cache: use only 1 Arc 2022-12-02 00:30:10 +01:00
6b03a828c8 gatherer/css: fix mobile width again 2022-11-30 23:11:38 +01:00
0cb79592d7 cargo update 2022-11-30 23:11:15 +01:00
39b830c2f7 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/50e42c7e4495a8a26a3373c3a0b0e9e4e8c0f799' (2022-11-24)
  → 'github:nix-community/fenix/bba229a06ca03938a1abd4ce6361bf9bf4f651cd' (2022-11-30)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/26562973b3482a635416b2b663a13016d4d90e20' (2022-11-20)
  → 'github:rust-lang/rust-analyzer/398a71affb05aeeea1991044ec9ca1229e68f0f3' (2022-11-29)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/8e8b5f3b1e899bf5d250279578c0283705b8cdb4' (2022-11-24)
  → 'github:NixOS/nixpkgs/227de2b3bbec142f912c09d5e8a1b4e778aa54fb' (2022-11-30)
2022-11-30 22:21:42 +01:00
789ec7568e gatherer/assets/tag_images.js: remove debug output 2022-11-29 03:17:28 +01:00
404767d88b gatherer: show images 2022-11-29 01:51:22 +01:00
d8b7ea06fd cave/store: filter bogus image urls that contain whitespace 2022-11-25 03:06:47 +01:00
691af99c36 gatherer/css: constrain <article> width 2022-11-25 02:43:53 +01:00
3e2efe9cf1 cave/store: gather 5 images per tag 2022-11-25 02:43:28 +01:00
f03a83e9cd hunter/tag_trimmer: act more gently 2022-11-24 19:25:03 +01:00
77997e9720 hunter: redisable reqwst feature rustls 2022-11-24 19:24:44 +01:00
12f1b421b2 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/16ba830351ba5e7c018919e8c70ef31350755f42' (2022-11-19)
  → 'github:nix-community/fenix/50e42c7e4495a8a26a3373c3a0b0e9e4e8c0f799' (2022-11-24)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/791cb87cdf47ddfd2a2b1a726dab3aa66ec2bff3' (2022-11-18)
  → 'github:rust-lang/rust-analyzer/26562973b3482a635416b2b663a13016d4d90e20' (2022-11-20)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/a1b4a562216eba8df3053bd869155dde4b5bca12' (2022-11-19)
  → 'github:NixOS/nixpkgs/8e8b5f3b1e899bf5d250279578c0283705b8cdb4' (2022-11-24)
2022-11-24 18:49:12 +01:00