FUSE 用户空间文件系统 (Filesystem in Userspace)

2020-12-30 10:37:20 浏览数 (1)

FUSE 仓库 

Wiki

Fuse说明,内核文档

FUSE系统IO模式

FUSE 性能评测


关于Fuse文件系统:

FUSE (Filesystem in Userspace) is an interface for userspace programs to export a filesystem to the Linux kernel. The FUSE project consists of two components: the fuse kernel module (maintained in the regular kernel repositories) and the _libfuse_userspace library (maintained in this repository). libfuse provides the reference implementation for communicating with the FUSE kernel module.

A FUSE file system is typically implemented as a standalone application that links with libfuse. libfuse provides functions to mount the file system, unmount it, read requests from the kernel, and send responses back. libfuse offers two APIs: a "high-level", synchronous API, and a "low-level" asynchronous API. In both cases, incoming requests from the kernel are passed to the main program using callbacks. When using the high-level API, the callbacks may work with file names and paths instead of inodes, and processing of a request finishes when the callback function returns. When using the low-level API, the callbacks must work with inodes and responses must be sent explicitly using a separate set of API functions.


FUSE 宏观调用:

以open为例,整个调用的过程如下:

1-      用户态app调用glibc open接口,触发sys_open系统调用。

2-      sys_open 调用fuse中inode节点定义的open方法。

3-      inode中open生成一个request消息,并通过/dev/fuse发送request消息到用户态libfuse。

4-      Libfuse调用fuse_application用户自定义的open的方法,并将返回值通过/dev/fuse通知给内核。

5-      内核收到request消息的处理完成的唤醒,并将结果放回给VFS系统调用结果。

6- 用户态app收到open的返回结果。


FUSE 包含两个大的发行版本:fuse2 和 fuse3 ,那么fuse2 和 fuse3之间有什么区别呢?(What exactly is the difference between fuse2 and fuse3?


FUSE 安装

FUSE 安装分为两种方式,一种是 编译安装,另外一张是通过包管理软件(YUM)进行安装。编译安装按照官方教程安装即可。

我使用的操作系统是 Fedora 29, 所以尝试使用yum进行安装:

首先使用rpm 命令查一下当前系统是否已经安装了fuse:

代码语言:javascript复制
[root@docker 4.19.13-300.fc29.x86_64]# rpm -aq | grep fuse
fuse-common-3.2.3-14.fc29.x86_64
fuse-2.9.7-14.fc29.x86_64
fuse-libs-2.9.7-14.fc29.x86_64
glusterfs-fuse-5.2-1.fc29.x86_64
gvfs-fuse-1.38.1-1.fc29.x86_64
zfs-fuse-0.7.2.2-6.fc27.x86_64

可见已经安装好了,当前系统中使用的是fuse的2.9.7版本,并且是有相应的库。所以算是已经安装好了。如果系统中没有上述安装包,可以使用yum进行安装。

代码语言:javascript复制
[root@docker 4.19.13-300.fc29.x86_64]# yum search fuse
Last metadata expiration check: 1:10:16 ago on Sat 12 Jan 2019 10:13:49 PM CST.
============================================================================ Summary & Name Matched: fuse ============================================================================
fuse.x86_64 : File System in Userspace (FUSE) v2 utilities
fuse.x86_64 : File System in Userspace (FUSE) v2 utilities
fuse-libs.x86_64 : File System in Userspace (FUSE) v2 libraries
fuse-libs.i686 : File System in Userspace (FUSE) v2 libraries
fuse-libs.x86_64 : File System in Userspace (FUSE) v2 libraries
fuse3-libs.i686 : File System in Userspace (FUSE) v3 libraries
fuse3-libs.x86_64 : File System in Userspace (FUSE) v3 libraries
fuse-devel.i686 : File System in Userspace (FUSE) v2 devel files
fuse-devel.x86_64 : File System in Userspace (FUSE) v2 devel files
fuse3-devel.i686 : File System in Userspace (FUSE) v3 devel files
fuse3-devel.x86_64 : File System in Userspace (FUSE) v3 devel files
fuse-common.x86_64 : Common files for File System in Userspace (FUSE) v2 and v3
fuse-common.x86_64 : Common files for File System in Userspace (FUSE) v2 and v3

通过自己的需求,安装对应版本的安装包:fuse-common.x86_64 这个软件包在v2和v3两个版本中都能进行使用。当然你也可以查看包里的内容,进一步了解fuse的组成。

fuse 的内核模块也已经内置到操作系统内核之中了:

代码语言:javascript复制
[root@docker fuse]# pwd
/lib/modules/4.19.10-300.fc29.x86_64/kernel/fs/fuse
[root@docker fuse]# ls
fuse.ko.xz

为了能够开发属于自己的文件系统,还要安装fuse开发包:

代码语言:javascript复制
fuse-devel.x86_64 : File System in Userspace (FUSE) v2 devel files
代码语言:javascript复制
Name         : fuse-devel
Version      : 2.9.7
Release      : 14.fc29
Arch         : x86_64
Size         : 36 k
Source       : fuse-2.9.7-14.fc29.src.rpm
Repo         : fedora
Summary      : File System in Userspace (FUSE) v2 devel files
URL          : http://fuse.sf.net
License      : LGPLv2 
Description  : With FUSE it is possible to implement a fully functional filesystem in a
             : userspace program. This package contains development files (headers,
             : pgk-config) to develop FUSE v2 based applications/filesystems.

我们从包描述可以看到,包中包括了一些开发所需要一些头文件, 动态链接库(.so),pgk-config 文件等。


 FUSE 简单使用(DEMO)

 high-level API:

代码语言:javascript复制
/*
  FUSE: Filesystem in Userspace
  Copyright (C) 2001-2007  Miklos Szeredi <miklos@szeredi.hu>

  
  This program can be distributed under the terms of the GNU GPL.
  See the file COPYING.

  gcc -Wall hello.c `pkg-config fuse --cflags --libs` -o hello
*/

#define FUSE_USE_VERSION 26 //先定义, fuse.h中有判断

#include <fuse.h>
#include <stdio.h>
#include <string.h>
#include <errno.h>
#include <fcntl.h>

static const char *hello_str = "Hello World!n";
static const char *hello_path = "/hello";

// 与函数stat()类似,用于得到文件属性,并将其存入到结构体struct stat当中 struct stat *stbuf
static int hello_getattr(const char *path, struct stat *stbuf)
{
    int res = 0;

    memset(stbuf, 0, sizeof(struct stat));  // 使用memset进行初始化结构体
    if (strcmp(path, "/") == 0) {
        stbuf->st_mode = S_IFDIR | 0755; // S_IFDIR 用于说明 / 为目录
        stbuf->st_nlink = 2;
    } else if (strcmp(path, hello_path) == 0) {
        stbuf->st_mode = S_IFREG | 0444; // S_IFREG 用于说明/hello 为常规文件
        stbuf->st_nlink = 1;
        stbuf->st_size = strlen(hello_str); // 设置文件长度为hello_str的长度
    } else
        res = -ENOENT; // 返回错误信息,没有该文件或者目录

    return res; // 成功执行的时候,此函数返回值为 0
}

// 该函数用于读取目录中的内容,并在/目录下增加了. .. hello 三个目录项
static int hello_readdir(const char *path, void *buf, fuse_fill_dir_t filler,
             off_t offset, struct fuse_file_info *fi)
{
    (void) offset;
    (void) fi;

    if (strcmp(path, "/") != 0)
        return -ENOENT;

    /* fill, 其作用是在readdir函数中增加一个目录项
    typedef int (*fuse_fill_dir_t) (void *buf, const char *name,
        const struct stat *stbuf, off_t off);
    */

    filler(buf, ".", NULL, 0);
    filler(buf, "..", NULL, 0);
    filler(buf, hello_path   1, NULL, 0); //指针 1(/hello), 即增加 hello 目录项,去掉前面的'/'

    return 0;
}

// 打开文件函数
static int hello_open(const char *path, struct fuse_file_info *fi)
{
    if (strcmp(path, hello_path) != 0)
        return -ENOENT;

    if ((fi->flags & 3) != O_RDONLY)
        return -EACCES;

    return 0;
}

// 读文件函数
static int hello_read(const char *path, char *buf, size_t size, off_t offset,
              struct fuse_file_info *fi)
{
    size_t len;
    (void) fi;
    if(strcmp(path, hello_path) != 0)
        return -ENOENT;

    len = strlen(hello_str);
    if (offset < len) {
        if (offset   size > len)
            size = len - offset;
        memcpy(buf, hello_str   offset, size);
    } else
        size = 0;

    return size;
}

// 注册自定义函数
static struct fuse_operations hello_oper = {
    .getattr    = hello_getattr,
    .readdir    = hello_readdir,
    .open        = hello_open,
    .read        = hello_read, // 读文件函数
};

// 调用 fuse_main , 把控制权交给了fuse
int main(int argc, char *argv[])
{
    return fuse_main(argc, argv, &hello_oper, NULL);
}

执行:

代码语言:javascript复制
挂载:
[root@docker example]# mkdir /tmp/fuse
[root@docker fuse-example]# ./hello /tmp/fuse/
[root@docker fuse-example]# cd /tmp/fuse/

读取文件属性:
[root@docker fuse]# ll
total 0
-r--r--r--. 1 root root 13 Jan  1  1970 hello
读取目录属性:
[root@docker tmp]# ll /tmp/
total 4
drwxr-xr-x. 2 root root   0 Jan  1  1970 fuse

卸载:
[root@docker tmp]# fusermount -u /tmp/fuse 
[root@docker tmp]# ls /tmp/fuse/

当然你也可以修改代码,对fuse的特性进一步尝试。

low-level API: low-level api 相对于 high-level api 来说,有更好的自由度;high-level相对于 low-level api 则有更简单的api使用,如果阅读过fuse源码过后,使用low-level api将使得可控性更强。下面是hello.c 的low-level api 版本

代码语言:javascript复制
/*
  FUSE: Filesystem in Userspace
  Copyright (C) 2001-2007  Miklos Szeredi <miklos@szeredi.hu>

  This program can be distributed under the terms of the GNU GPL.
  See the file COPYING.

  gcc -Wall hello_ll.c `pkg-config fuse --cflags --libs` -o hello_ll
*/

#define FUSE_USE_VERSION 26

#include <fuse_lowlevel.h>
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <errno.h>
#include <fcntl.h>
#include <unistd.h>
#include <assert.h>

static const char *hello_str = "Hello World!n";
static const char *hello_name = "hello";

static int hello_stat(fuse_ino_t ino, struct stat *stbuf)
{
    stbuf->st_ino = ino;
    switch (ino) {
    case 1:
        stbuf->st_mode = S_IFDIR | 0755;
        stbuf->st_nlink = 2;
        break;

    case 2:
        stbuf->st_mode = S_IFREG | 0444;
        stbuf->st_nlink = 1;
        stbuf->st_size = strlen(hello_str);
        break;

    default:
        return -1;
    }
    return 0;
}

static void hello_ll_getattr(fuse_req_t req, fuse_ino_t ino,
                 struct fuse_file_info *fi)
{
    struct stat stbuf;

    (void) fi;

    memset(&stbuf, 0, sizeof(stbuf));
    if (hello_stat(ino, &stbuf) == -1)
        fuse_reply_err(req, ENOENT);
    else
        fuse_reply_attr(req, &stbuf, 1.0);
}

static void hello_ll_lookup(fuse_req_t req, fuse_ino_t parent, const char *name)
{
    struct fuse_entry_param e;

    if (parent != 1 || strcmp(name, hello_name) != 0)
        fuse_reply_err(req, ENOENT);
    else {
        memset(&e, 0, sizeof(e));
        e.ino = 2;
        e.attr_timeout = 1.0;
        e.entry_timeout = 1.0;
        hello_stat(e.ino, &e.attr);

        fuse_reply_entry(req, &e);
    }
}

struct dirbuf {
    char *p;
    size_t size;
};

static void dirbuf_add(fuse_req_t req, struct dirbuf *b, const char *name,
               fuse_ino_t ino)
{
    struct stat stbuf;
    size_t oldsize = b->size;
    b->size  = fuse_add_direntry(req, NULL, 0, name, NULL, 0);
    b->p = (char *) realloc(b->p, b->size);
    memset(&stbuf, 0, sizeof(stbuf));
    stbuf.st_ino = ino;
    fuse_add_direntry(req, b->p   oldsize, b->size - oldsize, name, &stbuf,
              b->size);
}

#define min(x, y) ((x) < (y) ? (x) : (y))

static int reply_buf_limited(fuse_req_t req, const char *buf, size_t bufsize,
                 off_t off, size_t maxsize)
{
    if (off < bufsize)
        return fuse_reply_buf(req, buf   off,
                      min(bufsize - off, maxsize));
    else
        return fuse_reply_buf(req, NULL, 0);
}

// 读取文件夹目录
static void hello_ll_readdir(fuse_req_t req, fuse_ino_t ino, size_t size,
                 off_t off, struct fuse_file_info *fi)
{
    (void) fi;

    if (ino != 1)
        fuse_reply_err(req, ENOTDIR);
    else {
        struct dirbuf b;

        memset(&b, 0, sizeof(b));
        dirbuf_add(req, &b, ".", 1);
        dirbuf_add(req, &b, "..", 1);
        dirbuf_add(req, &b, hello_name, 2);
        reply_buf_limited(req, b.p, b.size, off, size);
        free(b.p);
    }
}

// 处理打开操作函数,检查权限
static void hello_ll_open(fuse_req_t req, fuse_ino_t ino,
              struct fuse_file_info *fi)
{
    if (ino != 2)
        fuse_reply_err(req, EISDIR);
    else if ((fi->flags & 3) != O_RDONLY)
        fuse_reply_err(req, EACCES);
    else
        fuse_reply_open(req, fi);
}

// 读取函数 返回 hello_str 中的值
static void hello_ll_read(fuse_req_t req, fuse_ino_t ino, size_t size,
              off_t off, struct fuse_file_info *fi)
{
    (void) fi;

    assert(ino == 2);
    reply_buf_limited(req, hello_str, strlen(hello_str), off, size);
}

// 注册的自定义函数
static struct fuse_lowlevel_ops hello_ll_oper = {
    .lookup        = hello_ll_lookup,
    .getattr    = hello_ll_getattr,
    .readdir    = hello_ll_readdir,
    .open        = hello_ll_open,
    .read        = hello_ll_read,
};

int main(int argc, char *argv[])
{
    // FUSE_ARGS_INIT 本身是一个宏函数,用于生成 struct fuse_args 结构体, 结构体在源代码 fuse_opt.h 文件建中定义;
    struct fuse_args args = FUSE_ARGS_INIT(argc, argv); 
    
    // A communication channel, providing hooks for sending and receiving* messages
    struct fuse_chan *ch; // 与 fuse 中 session 相关, 在源代码 fuse_session.c 中进行定义 一个channel 

    char *mountpoint; // 一个字符串指针
    int err = -1; // 错误返回值,默认的返回值为 -1

    // fuse_parse_cmdline 是解析命令行参数的一种工具类,他可以解析fuse本身自身的选项,第一个出现的非选项参数被认为是挂载点
    // 如果出现多个非选项参数,则认为是错误!
    if (fuse_parse_cmdline(&args, &mountpoint, NULL, NULL) != -1 &&
        // 挂载, 调用了底层的 fuse_mount_common 函数
        (ch = fuse_mount(mountpoint, &args)) != NULL) {
        struct fuse_session *se;

        // 创建一个session
        se = fuse_lowlevel_new(&args, &hello_ll_oper,
                       sizeof(hello_ll_oper), NULL);
        if (se != NULL) {
            if (fuse_set_signal_handlers(se) != -1) {
                fuse_session_add_chan(se, ch);
                err = fuse_session_loop(se); // 处理信息
                fuse_remove_signal_handlers(se);
                fuse_session_remove_chan(ch);
            }
            fuse_session_destroy(se);
        }
        fuse_unmount(mountpoint, ch);
    }
    // 释放参数占用的空间
    fuse_opt_free_args(&args);

    return err ? 1 : 0;
}

执行:(同样执行和High-level API 相同的操作进行验证)


 上面第二个代码,我只注释了很少一部分,因为我还有一部分源码没有看懂,为此我专门写了另外一篇文章来记录我对fuse 示例代码 的注释,等看懂后陆续更新对应注释,希望能帮助你。

FUSE 文件系统 example部分 源码注释 (libfuse 2.9.9)

资源来源自网络,保持更新,转载请注明出处。https://cloud.tencent.com/developer/article/1766726

0 人点赞