Commit Graph

58 Commits

Author SHA1 Message Date
projectmoon cc849ba4fa remove temp file 2023-12-14 00:48:49 +01:00
projectmoon a85e1324a5 Temporarily disable the fetch_instance_follows call 2023-12-14 00:45:59 +01:00
projectmoon 5388beeb86 Handle existing blocks in a smarter way 2023-12-01 23:27:37 +01:00
projectmoon e3aae6b2a9 Add FediFetcher license 2023-11-30 12:17:20 +01:00
projectmoon 28004d3c0b support misskey blocks 2023-11-30 12:03:51 +01:00
Shawn Grigson 58dbed0fa8 some updates to wording/help for override_private_comment 2023-10-02 13:48:13 -05:00
Shawn Grigson 0a63a47ff1 more revert 2023-09-12 08:14:53 -05:00
Shawn Grigson 3592c97627 revert 2023-09-12 08:13:17 -05:00
Shawn Grigson 4d360e6b53 block more errors for 401 2023-09-12 02:43:02 -05:00
Shawn Grigson a1f81d197f Fix 401 for add block, too 2023-09-12 02:39:16 -05:00
Shawn Grigson d1fe11abf5 readme updates also 401 status_code becomes skippable 2023-09-12 02:34:56 -05:00
Shawn Grigson bda8bf5ebb meh 2023-09-10 19:38:09 -05:00
Shawn Grigson c372b210d8 tweak 2023-09-10 19:34:50 -05:00
Shawn Grigson 705965a17c audit update 2023-09-10 19:20:17 -05:00
Shawn Grigson 2a96ea7245 add private comment to proper place for debugging 2023-09-10 18:06:51 -05:00
Shawn Grigson a4be5ff675 Revert "try with import field"
This reverts commit b833ad6d41.
2023-09-10 18:03:06 -05:00
Shawn Grigson b833ad6d41 try with import field 2023-09-10 18:00:43 -05:00
Shawn Grigson b297e390f7 remove import fields update 2023-09-10 17:29:57 -05:00
Shawn Grigson 9f0c36e751 fix, only add private comment for new blocks 2023-09-10 17:27:01 -05:00
Shawn Grigson 9ca042ab74 Override the private comment 2023-09-10 17:21:46 -05:00
Shawn Grigson b86f7cd0e4 Default to None 2023-09-06 11:26:02 -05:00
Shawn Grigson 6f960aefec Create Domain Audit File Option
Allows for the creation of an audit file that will explain for each domain the number of matches across available sources
2023-08-20 02:50:05 -05:00
Justin Warren 8265639047
Use __future__.annotations so type hints
work with Python < 2.9
2023-07-09 07:33:26 +10:00
Justin Warren 9f95f143df
Added parser for Mastodon 4.1 blocklist CSV format 2023-02-13 10:22:33 +11:00
Justin Warren bb1d89e8be
Added blocklist threshold config params.
Added tests for threshold config params.
Actually using the config values in merge_blocklists()
2023-02-12 18:06:07 +11:00
Justin Warren b67ff0c471
Merging domain above threshold needs to be in the threshold check block.
Added debugging statements for threshold merging.
2023-02-12 17:53:26 +11:00
Justin Warren 1e377099f0
Merge branch 'main' into allowlist-thresholds 2023-02-12 16:11:00 +11:00
Justin Warren fb3a7ec2da
Added tests of comment merging.
Tweaked comment merging to pass tests.
2023-01-22 13:25:40 +11:00
Justin Warren b8aa11e5ce
Don't merge comments if new comment is empty. 2023-01-22 13:15:29 +11:00
Justin Warren 3b4cdcbcdf
Refactored the code to use Blocklist data structure for allowlists.
Fixed bug in parse_blocklist() for preparse selection.
Updated test cases for allowlists.
Removed some code that is no longer needed.
2023-01-22 13:05:44 +11:00
Justin Warren c018ebdf35
Add merge thresholds to merge_blocklists() 2023-01-22 09:02:03 +11:00
Justin Warren e0207c4371
Remove unnecessary `count` from DomainBlock object. 2023-01-22 09:01:30 +11:00
Justin Warren e59187d98f
Merge branch 'main' into allowlist-thresholds 2023-01-22 08:27:21 +11:00
Justin Warren 9fe934240a
Added Mastodon public API parser type because #33
Added ability to set scheme when talking to instances.
2023-01-22 07:54:46 +11:00
Shawn Grigson 8d3b9da144 Blockdata var already converted to _asdict() 2023-01-17 17:17:59 -06:00
Justin Warren 70b1ff32ff
Support a merge threshold level.
Added a Blocklist object.
Refactored tests to match changed code.
2023-01-17 09:04:34 +11:00
Justin Warren a25773f838
Allowlists just remove blocks from merged list before push. 2023-01-15 13:33:32 +11:00
Justin Warren 3aa2e378e3
Remove implied setting of reject_media/reports
if severity is set to 'suspend'.
Complicates understanding of what the code actually does.
2023-01-15 10:02:12 +11:00
Justin Warren 04c19c62df
Merge branch 'main' into allowlists 2023-01-15 09:56:13 +11:00
Justin Warren 11accf33d3
Restructured argparsing for easier testing.
Fixed bug: mergeplan in config file was ignored. Reported in #22
Added test cases for cmdline parsing.
Added test cases for configfile parsing.
2023-01-15 09:46:37 +11:00
Justin Warren 17e0bdab0b
Force allowlist entries to always be severity 'noop'. 2023-01-14 11:00:21 +11:00
Justin Warren 6d4e18bbf6
Fixed bug in how DomainBlock defaults
handle reject_media, reject_reports.
2023-01-14 10:59:19 +11:00
Justin Warren 7a31c3380e
Added support for allowlists.
Updated docstring for merge_blocklists()
2023-01-14 10:44:08 +11:00
Justin Warren 894b133fbb
str2bool() now converts '' to False.
Added some extra debug logging of blocklist parsing.
2023-01-14 10:43:17 +11:00
Justin Warren 9817c99e40
Fixed bug in _asdict() of severity level. 2023-01-14 10:41:54 +11:00
Justin Warren 69c28f1a3f
add DomainBlock type hint to update_known_block().
Use ._asdict() to get info to pass to add block API call.
2023-01-13 17:31:50 +11:00
Justin Warren a718af5a0b
Fix DomainBlock.id usage during __iter__() 2023-01-13 17:30:41 +11:00
Justin Warren 55dad3fa32
Aligned API call rate limit with server default. 2023-01-13 17:12:23 +11:00
Justin Warren e0d40b5861
Fixed bug in severity change detection. 2023-01-12 09:31:16 +11:00
Justin Warren 327a44d907
Removed redundant global vars.
Refactored fetch from URLs and instances.
Change API delay to be in calls per hour.
Improved check_followed_severity() behaviour.
Updated sample config to include new format.
Added support for per-instance-source import_fields.
BlockSeverity of 'suspend' implies reject_media and reject_reports.
2023-01-12 09:09:06 +11:00