Commit Graph

347 Commits

Author SHA1 Message Date
Astro 69b1285b03 gatherer/tempates/trends: link relay.fedi.buzz 2023-01-22 01:55:08 +01:00
Astro f2e65fd6cd hunter: split into butcher 2023-01-22 00:05:10 +01:00
Astro 776f3ab48c Cargo.lock: update 2023-01-20 17:58:32 +01:00
Astro 8219b3be29 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/3966a723f5a710b70aaafa29eb277db0389183db' (2023-01-13)
  → 'github:nix-community/fenix/f0868a6cb6ab20291e90ce1b130a5d1eb99f96b6' (2023-01-20)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/fb39efe26cfbc81e5ed5e6518262fcc2d44229c2' (2023-01-12)
  → 'github:rust-lang/rust-analyzer/6e52c64031825920983515b9e975e93232739f7f' (2023-01-19)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/37b97ae3dd714de9a17923d004a2c5b5543dfa6d' (2023-01-13)
  → 'github:NixOS/nixpkgs/2d38b664b4400335086a713a0036aafaa002c003' (2023-01-17)
2023-01-20 17:33:11 +01:00
Astro aeee95fa13 cave/store: fix TAG_EXPIRE multiplication 2023-01-16 04:16:40 +01:00
Astro 57a9422d74 Cargo.lock: update 2023-01-16 04:16:27 +01:00
Astro 13b8196ba9 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/918a43f74c47473dc979fd5b25746121e6afb48f' (2023-01-09)
  → 'github:nix-community/fenix/3966a723f5a710b70aaafa29eb277db0389183db' (2023-01-13)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/1bd1a095936f2c16493743a05f6f14285c98ec8a' (2023-01-07)
  → 'github:rust-lang/rust-analyzer/fb39efe26cfbc81e5ed5e6518262fcc2d44229c2' (2023-01-12)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/0c9aadc8eff6daaa5149d2df9e6c49baaf44161c' (2023-01-08)
  → 'github:NixOS/nixpkgs/37b97ae3dd714de9a17923d004a2c5b5543dfa6d' (2023-01-13)
2023-01-14 04:04:03 +01:00
Astro 6e672e95fd cave/store: extend UNSAFE_TAGS 2023-01-14 04:03:45 +01:00
Astro 3c023eb8e4 cargo update 2023-01-10 01:05:49 +01:00
Astro f31718d44f flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/9049ab18f824a092b3c74dae9f690681c0a39dfa' (2022-12-25)
  → 'github:nix-community/fenix/918a43f74c47473dc979fd5b25746121e6afb48f' (2023-01-09)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/1927c2e1d8d222656cae7051cdd924aa44428622' (2022-12-24)
  → 'github:rust-lang/rust-analyzer/1bd1a095936f2c16493743a05f6f14285c98ec8a' (2023-01-07)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/aac1f0b25e6b04afad8e05dec5828f5c02398bd1' (2022-12-25)
  → 'github:NixOS/nixpkgs/0c9aadc8eff6daaa5149d2df9e6c49baaf44161c' (2023-01-08)
2023-01-09 21:10:22 +01:00
Astro 54e63744fc gatherer/trends: add metric trends_page_tags 2022-12-30 19:56:14 +01:00
Astro 4a22eb70a7 gatherer: swap <article> and <section> 2022-12-30 19:55:08 +01:00
Astro 077feb4c6c hunter/trend_setter: fix removal of tags from trend_pools 2022-12-30 19:51:09 +01:00
Astro 20c072f72e gatherer/http_server: move metric trends_page_time to TrendAnalyzer.run() for higher granularity 2022-12-30 03:22:35 +01:00
Astro 934aa1461a gatherer/http_server: add metrics 2022-12-30 02:59:09 +01:00
Astro b05d62db73 cave/store: extend UNSAFE_TAGS 2022-12-30 01:56:31 +01:00
Astro 1995fec968 gatherer/request_mux: eliminate 2022-12-30 01:56:20 +01:00
Astro e806e671cd gatherer/request_mux: panic on REQUEST_TIMEOUT 2022-12-29 20:34:04 +01:00
Astro 31f5836e8a gatherer/main: parallelize images queries 2022-12-29 20:28:39 +01:00
Astro 5f708a38c1 gatherer/main: parallelize query 2022-12-29 20:12:05 +01:00
Astro 33d5221e12 hunter/main: enable reqwest tcp_keepalive 2022-12-29 15:30:35 +01:00
Astro df50718724 Revert "hunter/worker: invert hunter_new_post_ratio metric"
This reverts commit 5260090b19.
2022-12-29 03:17:03 +01:00
Astro 5260090b19 hunter/worker: invert hunter_new_post_ratio metric 2022-12-27 20:34:34 +01:00
Astro 704b883de2 hunter/worker: adjust new posts log level 2022-12-27 19:05:53 +01:00
Astro ff9c64ec1a hunter: add more metrics 2022-12-27 19:03:09 +01:00
Astro 01972899ae hunter/trend_setter: reduce metrics histogram facets 2022-12-27 03:54:09 +01:00
Astro 39d0aa823c cave/init: replace console_subscriber with tracing_subscriber 2022-12-27 03:52:20 +01:00
Astro feb60d9805 hunter/worker: measure hunter_worker_starts 2022-12-26 04:30:27 +01:00
Astro 262ac7ad73 hunter/trend_setter: add metrics 2022-12-26 04:21:42 +01:00
Astro aeec4045a0 hunter/worker: catch runaway metrics 2022-12-26 04:14:10 +01:00
Astro 3759779903 nixos-module: lift LimitRSS for caveman-hunter a bit 2022-12-26 03:50:18 +01:00
Astro ce3f184d04 hunter: add metrics for prometheus 2022-12-26 03:46:11 +01:00
Astro f5fb098bd2 switch from log to tracing 2022-12-26 03:05:00 +01:00
Astro 66a3deb6b2 gatherer/templates/html: update me 2022-12-26 02:52:07 +01:00
Astro 21e670cd2c hunter: remove evil hosts from redis again 2022-12-26 02:49:43 +01:00
Astro ad8080d9cf cave/store: let hosts expire 2022-12-26 02:49:22 +01:00
Astro 232a5adabd gather/tag_images.js: add image alt 2022-12-26 02:26:22 +01:00
Astro 484992b92b hunter/main: call systemd::extend_timeout() only every 1000 reintroduced hosts 2022-12-26 02:25:50 +01:00
Astro 0195cab965 hunter/scheduler: commit the fixed EVIL_DOMAINS check 2022-12-26 02:25:13 +01:00
Astro b6d1c0dabc cave/store: commit all UNSAFE_TAGS 2022-12-26 02:24:17 +01:00
Astro a0b7ae8b3b cargo update 2022-12-26 02:23:58 +01:00
Astro fe5fb87819 flake.lock: Update
Flake lock file updates:

• Updated input 'fenix':
    'github:nix-community/fenix/bba229a06ca03938a1abd4ce6361bf9bf4f651cd' (2022-11-30)
  → 'github:nix-community/fenix/9049ab18f824a092b3c74dae9f690681c0a39dfa' (2022-12-25)
• Updated input 'fenix/rust-analyzer-src':
    'github:rust-lang/rust-analyzer/398a71affb05aeeea1991044ec9ca1229e68f0f3' (2022-11-29)
  → 'github:rust-lang/rust-analyzer/1927c2e1d8d222656cae7051cdd924aa44428622' (2022-12-24)
• Updated input 'naersk':
    'github:nmattia/naersk/6944160c19cb591eb85bbf9b2f2768a935623ed3' (2022-09-03)
  → 'github:nmattia/naersk/d998160d6a076cfe8f9741e56aeec7e267e3e114' (2022-12-15)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/227de2b3bbec142f912c09d5e8a1b4e778aa54fb' (2022-11-30)
  → 'github:NixOS/nixpkgs/aac1f0b25e6b04afad8e05dec5828f5c02398bd1' (2022-12-25)
2022-12-26 02:15:26 +01:00
Astro 47aa137c22 Cargo.toml: fix by moving optimization config to project root 2022-12-04 03:55:36 +01:00
Astro ea0fe54106 hunter/scheduler: filter EVIL_DOMAINS 2022-12-04 03:54:42 +01:00
Astro 908fb9c8d3 */Cargo.toml: add optimization flags 2022-12-03 01:51:38 +01:00
Astro c1d2c3786d hunter/main: use jemalloc 2022-12-03 01:47:44 +01:00
Astro fed37ce56f hunter/main: enable trust-dns
seems to use even more memory but perhaps we're no longer bound by
worker threads?
2022-12-03 01:47:07 +01:00
Astro 2afcd46a99 cave/store: extend UNSAFE_TAGS 2022-12-03 00:48:37 +01:00
Astro cd132a67bc cave/feed: clean up with EncodedPost 2022-12-02 23:05:35 +01:00
Astro 470012a005 gatherer/assets/hour_graph.js: round curves for relevant period 2022-12-02 22:23:57 +01:00