danboorufs: danboorufs.py annotate

annotate danboorufs.py @ 5:a422e75bf464 draft

Default to symlinks mode, since it’s better.

author	Emmanuel Gil Peyrot <linkmauve@linkmauve.fr>
date	Wed, 22 Aug 2012 11:47:19 +0200
parents	c40f0eed70cd
children	2c81cc41de2d

rev	line source
3 880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	1 #!/usr/bin/env python
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	2 # -- encoding: utf-8 --
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	3 #
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	4 #
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	5 # Copyright © 2012 Emmanuel Gil Peyrot <linkmauve@linkmauve.fr>
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	6 #
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	7 # Permission is hereby granted, free of charge, to any person obtaining a copy
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	8 # of this software and associated documentation files (the "Software"), to deal
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	9 # in the Software without restriction, including without limitation the rights
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	10 # to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	11 # copies of the Software, and to permit persons to whom the Software is
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	12 # furnished to do so, subject to the following conditions:
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	13 #
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	14 # The above copyright notice and this permission notice shall be included in
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	15 # all copies or substantial portions of the Software.
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	16 #
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	17 # THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	18 # IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	19 # FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	20 # AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	21 # LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	22 # OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	23 # SOFTWARE.
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	24
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	25
3 880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	26 from __future__ import with_statement, unicode_literals
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	27
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	28 from errno import ENOENT, ENOTDIR
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	29 from sys import argv
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	30 from threading import Lock
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	31 from time import time
3 880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	32 from functools import reduce
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	33
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	34 import os
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	35
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	36 from fuse import FUSE, FuseOSError, Operations, LoggingMixIn
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	37
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	38
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	39 class Danbooru(LoggingMixIn, Operations):
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	40 '''
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	41 Represent a list of images as a filesystem tree, with nice tag filtering.
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	42 '''
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	43
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	44 def __init__(self, tagfiles, root, use_symlinks):
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	45 '''
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	46 Takes a list of files containing the tags. They have to be named as the
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	47 image, with ".tags" at the end.
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	48 '''
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	49 self.paths = {}
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	50 self.files = {}
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	51 self.tags = {}
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	52 self.cache = {}
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	53
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	54 start = time()
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	55
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	56 for name in tagfiles:
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	57 filename = name.replace('.tags', '')
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	58 basename = os.path.basename(filename)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	59 self.paths[basename] = filename
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	60 tags = []
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	61 self.files[basename] = tags
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	62 with open(name, 'r') as tagfile:
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	63 for line in tagfile:
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	64 for tag in line.split():
3 880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	65 try:
880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	66 tag = tag.decode('UTF-8')
880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	67 except AttributeError:
880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	68 pass
880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	69 tag = tag.replace('/', '�') #XXX
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	70 tags.append(tag)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	71 self.tags.setdefault(tag, []).append(basename)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	72
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	73 print('[%d] Index done.' % (time() - start))
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	74
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	75 self.root = root
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	76 self.use_symlinks = use_symlinks
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	77 self.rwlock = Lock()
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	78
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	79 def _split_path(self, path):
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	80 if path == '/':
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	81 return (None, None)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	82
1 63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	83 real_path = path[1:].split('/')
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	84
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	85 # Remove the leading - of tag exclusion.
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	86 path = [tag[1:] if tag[0] == '-' else tag for tag in real_path]
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	87
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	88 for tag in path[:-1]:
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	89 if tag not in self.tags:
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	90 raise FuseOSError(ENOENT)
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	91
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	92 if path[-1] in self.tags:
1 63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	93 return (real_path, None)
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	94
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	95 if path[-1] not in self.paths:
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	96 raise FuseOSError(ENOENT)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	97
1 63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	98 return (real_path[:-1], self.paths[real_path[-1]])
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	99
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	100 def access(self, path, mode):
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	101 self._split_path(path)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	102
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	103 def getattr(self, path, file_handle=None):
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	104 _, filename = self._split_path(path)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	105 path = filename if filename else self.root
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	106 stat = os.lstat(path)
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	107 stat = dict((key, getattr(stat, key)) for key in ('st_atime',
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	108 'st_ctime', 'st_gid', 'st_mode', 'st_mtime',
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	109 'st_nlink', 'st_size', 'st_uid'))
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	110
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	111 if self.use_symlinks:
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	112 # Those modes are respectively for a symlink and a directory.
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	113 stat['st_mode'] = 0o120700 if filename else 0o40700
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	114 if filename:
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	115 stat['st_size'] = len(filename)
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	116
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	117 return stat
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	118
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	119 getxattr = None
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	120 listxattr = None
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	121
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	122 def open(self, path, flags):
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	123 _, filename = self._split_path(path)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	124 return os.open(filename, flags)
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	125
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	126 def read(self, path, size, offset, file_handle):
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	127 with self.rwlock:
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	128 os.lseek(file_handle, offset, 0)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	129 return os.read(file_handle, size)
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	130
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	131 def readdir(self, path, file_handle):
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	132 if path == '/':
3 880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	133 return (['.', '..'] + list(self.tags.keys())
880904f1071f Add python3 support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 2 diff changeset	134 + list(self.files.keys()))
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	135
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	136 tags, filename = self._split_path(path)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	137 if filename:
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	138 return FuseOSError(ENOTDIR)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	139
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	140 tags = set(tags)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	141
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	142 key = ' '.join(tags)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	143 if key in self.cache:
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	144 return ['.', '..'] + self.cache[key]
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	145
1 63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	146 inclusion_tags = set(tag for tag in tags if tag[0] != '-')
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	147 exclusion_tags = set(tag[1:] for tag in tags if tag[0] == '-')
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	148
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	149 # Get the list of the files corresponding to those tags.
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	150 files = reduce((lambda s, t: s.intersection(self.tags[t])),
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	151 inclusion_tags, set(self.files))
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	152 files -= set([f for f in files
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	153 if exclusion_tags.intersection(self.files[f])])
1 63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	154
63ccd8b0d615 Add tag exclusion support. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 0 diff changeset	155 # Those next two steps are for useless tags removal.
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	156
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	157 # Get the tags of those files.
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	158 taglist = reduce((lambda s, f: s.union(self.files[f])), files, set())
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	159 taglist -= tags
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	160
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	161 # Remove the tags that can’t precise the file list anymore.
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	162 remove = reduce((lambda s, f: s.intersection(self.files[f])), files,
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	163 taglist)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	164 taglist -= remove
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	165
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	166 self.cache[key] = list(taglist) + list(files)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	167 return ['.', '..'] + self.cache[key]
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	168
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	169 def readlink(self, path):
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	170 _, filename = self._split_path(path)
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	171 return filename
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	172
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	173 def release(self, path, file_handle):
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	174 return os.close(file_handle)
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	175
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	176 def statfs(self, path):
2 85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	177 _, filename = self._split_path(path)
85cbd44f98b1 Add license, (try to) respect the PEP 8, and don’t override the file builtin. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 1 diff changeset	178 path = filename if filename else self.root
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	179 stv = os.statvfs(path)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	180 return dict((key, getattr(stv, key)) for key in ('f_bavail', 'f_bfree',
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	181 'f_blocks', 'f_bsize', 'f_favail', 'f_ffree', 'f_files', 'f_flag',
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	182 'f_frsize', 'f_namemax'))
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	183
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	184 utimens = os.utime
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	185
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	186
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	187 def main(args):
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	188 mountpoint = args.pop()
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	189
5 a422e75bf464 Default to symlinks mode, since it’s better. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 4 diff changeset	190 if args[1] == '-n' or args[1] == '--no-symlinks':
a422e75bf464 Default to symlinks mode, since it’s better. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 4 diff changeset	191 use_symlinks = False
a422e75bf464 Default to symlinks mode, since it’s better. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 4 diff changeset	192 filelist = args[1:]
a422e75bf464 Default to symlinks mode, since it’s better. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 4 diff changeset	193 else:
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	194 use_symlinks = True
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	195 filelist = args[2:]
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	196
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	197 FUSE(Danbooru(filelist, os.path.dirname(mountpoint), use_symlinks),
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	198 mountpoint, foreground=True)
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	199
c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	200
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	201 if __name__ == '__main__':
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	202 if len(argv) < 3:
5 a422e75bf464 Default to symlinks mode, since it’s better. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 4 diff changeset	203 print('USAGE: %s' % argv[0], '[-n\|--no-symlinks]',
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	204 '<tag file> [<tag file>...]', '<mountpoint>')
0 215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	205 exit(1)
215d51f2a82f Initial commit. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: diff changeset	206
4 c40f0eed70cd Add a symlink mode, for performances reason. Emmanuel Gil Peyrot <linkmauve@linkmauve.fr> parents: 3 diff changeset	207 main(argv)

Mercurial > danboorufs

annotate danboorufs.py @ 5:a422e75bf464 draft