Commit graph

994 commits

Author SHA1 Message Date
23c7f8e520 twitterchiver/viewer: add stats to index page 2020-10-21 02:04:34 +00:00
0da26f3e42 twitterchiver/related_fetcher: move the fetch token counter to right before we do the fetch 2020-10-21 01:24:30 +00:00
Default email
d6cfb865ad Project import generated by Copybara.
GitOrigin-RevId: 5265d49a36bb5a18c85e6817b338b456acc3b8cc
2020-10-18 20:13:06 -04:00
e49cb8eb05 twitterchiver/related_fetcher: up the work-cap, but introduce an absolute cap on number of tweets actually fetched 2020-10-20 23:30:50 +00:00
c6071fc9d3 3p/nixpkgs: fix always adding nvidia-persistenced to environment.systemPackages 2020-10-20 01:28:09 +00:00
Default email
9c6d255489 Project import generated by Copybara.
GitOrigin-RevId: 8133b9cb5f7c00d4fe31c8c2c4b525bc2650bfc0
2020-10-16 20:44:37 +00:00
cab1df2966 twitterchiver/related_fetcher: treat 403 as deleted as well 2020-10-19 23:57:44 +00:00
e6180a6850 twitterchiver/related_fetcher: add separate flags for tick interval/work for each worker 2020-10-18 21:23:26 +01:00
297fc79db0 twitterchiver/related_fetcher: mark tweets as media-fetched if they have no media 2020-10-18 21:12:37 +01:00
be71055ea1 twitterchiver/viewer: restrict viewing to on_timeline tweets
We want to only display tweets in the search view that was in timeline, but
we do store entries in user_accounts_tweets for ACL purposes for replies/quote tweets.
2020-10-18 21:07:55 +01:00
50895e2aa3 twitterchiver/related_fetcher: fix marking tweets as done if they had no related content 2020-10-18 21:02:17 +01:00
cc8f24e8e1 twitterchiver: add relatedfetcher, to fetch referenced media and tweets 2020-10-18 20:44:50 +01:00
6c007869b6 buildGo: remove some additional references to srcs 2020-10-18 14:23:22 +00:00
38b2bb3516 docker-images: simplify a bit by decompressing at push time
This avoids Nix finding store paths in the output (because they're hidden), and
thus adding weird extraneous dependencies to the closure.
2020-10-18 13:59:31 +00:00
7b80b817dd copybara: depend on jdk14_headless instead of 'headful' jre 2020-10-18 13:26:29 +00:00
4e14ee8111 ops/nixos: mark nix.gc.automatic as default 2020-10-18 12:59:33 +00:00
e3f83ad608 ops/nixos: run nix-collect-garbage daily, except on clients 2020-10-18 01:17:35 +00:00
4466be3776 twitterchiver/viewer: set retweeted icon to grey 2020-10-18 01:08:47 +00:00
0d8ff4ba40 twitterchiver/viewer: add titles to pages 2020-10-18 01:08:12 +00:00
0fed7d1245 docker-images: add twitterchiver/viewer 2020-10-18 01:03:09 +01:00
c5a53d9334 twitterchiver: init viewer 2020-10-18 01:02:46 +01:00
36682c25cf Add new gopkgs for twitterchiver viewer. 2020-10-18 01:02:23 +01:00
1aa2236f64 graphical-client: add dino 2020-10-17 12:17:47 +01:00
89d3afd8f0 ops/nixos: move some things into a graphical-clients module 2020-10-17 12:17:18 +01:00
6edb818126 ixvm-fra01: add kernel modules for VirtIO disk 2020-10-15 13:50:52 +00:00
3bab7ede2d totoro: add secretsync 2020-10-15 13:22:18 +00:00
d5d4d6eb33 kusakabe: updates for XMPP 2020-10-15 13:24:37 +00:00
Default email
4a3aa3d7d8 Project import generated by Copybara.
GitOrigin-RevId: 24c9b05ac53e422f1af81a156f1fd58499eb27fb
2020-10-11 14:50:04 +02:00
Default email
1693fb2285 Project import generated by Copybara.
GitOrigin-RevId: 420f89ceb267b461eed5d025b6c3c0e57703cc5c
2020-10-07 11:15:18 +02:00
6b84fe71f7 ci-root: add docker images to ci-root 2020-10-10 21:02:23 +00:00
7f99b80dbe maint/update_nixpkgs: init 2020-10-10 17:10:33 +00:00
e0969055f6 ops/nixos: make references to nixpkgs modules use relative paths 2020-10-10 19:39:26 +00:00
11a7fefe1c totoro: add openshift dependencies, tailscale expose 192.168.1.0/24 2020-09-13 15:16:03 +00:00
949c86e816 kusakabe: enable send-proxy-v2 for requests to OKD haproxy 2020-10-06 00:29:37 +00:00
04c3a8431b go/openshiftauth: init
This is a small "library" for wrapping binaries with magic OAuth authentication based on the automatically-injected k8s service account tokens and OpenShift's OAuth service.

There's an example of this deployed at https://example-lukegb-openshiftauth-test.apps.k8s.lukegb.tech/.

The main pieces of setup that need to happen is:

* Set "serviceAccount" in pod definition
* Add Route for pod
* Edit serviceaccount and add metadata.annotations, e.g.:
    serviceaccounts.openshift.io/oauth-redirectreference.first: >-
      {"kind":"OAuthRedirectReference","apiVersion":"v1","reference":{"kind":"Route","name":"example"}}
2020-10-04 14:38:56 +01:00
9bd61285a7 third_party/gopkgs: import some more packages 2020-10-04 14:36:31 +01:00
b71cc68f24 go: move go.mod to go folder 2020-10-04 11:33:08 +01:00
014d1c881a twitterchiver/archiver: store mapping of tweet ID to user ID that saw it 2020-10-04 03:42:02 +01:00
68d8fa6d42 third_party/go: inject SSL_CERT_FILE into built containers 2020-10-04 03:14:53 +01:00
382dad7c6d marukuru: add nix config to deployer container 2020-10-04 03:00:03 +01:00
3325bac83b Backed out changeset 0a0814edc45e 2020-10-04 02:58:42 +01:00
190606746c ops/nixos/lib/common: add the binary cache credentials to nix.envVars 2020-10-04 02:56:34 +01:00
3b268f67c6 dockerpush: try to use the CI nix cache 2020-10-04 02:44:15 +01:00
9934098c50 gitlab-ci: move dockerpush into hack shell script 2020-10-04 02:36:18 +01:00
cb4100412a gitlab-ci: add docker-images push 2020-10-04 02:34:09 +01:00
d0e40e4a6b nix/pkgs: add crane 2020-10-04 02:33:44 +01:00
c384c31248 twitterchiver: move archiver to subattribute 2020-10-04 01:25:36 +01:00
ee7ad0adfd kusakabe: also expose k8s apiserver 2020-10-04 01:15:58 +01:00
225dfdc114 misc: fix up reuse lint 2020-10-04 01:08:07 +01:00
dd3c58548d go/twitterchiver: init 2020-10-04 01:07:59 +01:00