Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unable to import pool "cannot import 'pool' insufficient replicas" #17185

Open
Chavell3 opened this issue Mar 27, 2025 · 1 comment
Open

unable to import pool "cannot import 'pool' insufficient replicas" #17185

Chavell3 opened this issue Mar 27, 2025 · 1 comment
Labels
Type: Defect Incorrect behavior (e.g. crash, hang)

Comments

@Chavell3
Copy link

Chavell3 commented Mar 27, 2025 •
edited
Loading

System information from original system - TrueNAS Scale

Distribution Name | TrueNAS
Distribution Version | TrueNAS 24.10.2
Kernel Version | 6.6.44-production+truenas
Architecture | x64
OpenZFS Version | zfs-2.2.99-1
zfs-kmod-2.2.99-1

System information currently trying to import

Distribution Name | Debian - OpenMediaVault
Distribution Version | Debian 6.12.12
Kernel Version | 6.12.12+bpo-amd64
Architecture | x64
OpenZFS Version | zfs-2.3.1-1bpo12+1
zfs-kmod-2.3.1-1bpo12+1

What happened and current status

I'm not able to import the pool after I exported the pool on the TrueNAS system.
One of the messages I get at some point, when trying to import the pool is:

cannot import 'data': insufficient replicas. Destroy and re-create the pool from a backup source.

But the pool itself is showing as good from zpool import

  pool: data
    id: 7520744140823365409
 state: ONLINE
status: Some supported features are not enabled on the pool.
        (Note that they may be intentionally disabled if the
        'compatibility' property is set.)
action: The pool can be imported using its name or numeric identifier, though
        some features will not be available without an explicit 'zpool upgrade'.
config:

        data                                      ONLINE
          raidz1-0                                ONLINE
            fb279caa-3beb-4dd0-9a05-a5dd7ed6b5bf  ONLINE
            a27d69a0-d282-44bf-82d4-5099e5a7ae0c  ONLINE
            7ac5a1f0-a702-45a5-be4d-0690cb75b1fd  ONLINE
            ed9d7738-5a31-44aa-a10d-6436f124eec9  ONLINE
            5143f30c-8958-4717-9518-cf1446eb00f8  ONLINE
            24a3ab8d-de4f-4f89-84a7-22c62f1179ea  ONLINE
            57cabe09-3470-4f8e-9250-7550f632c66c  ONLINE
            0c772af9-1292-417b-b7db-e18f8418158c  ONLINE
            a9c780a6-da11-4a7d-b08d-b648b912f0be  ONLINE
        special
          mirror-2                                ONLINE
            1afcdfa9-474b-4d3d-9cc5-496aa4f69453  ONLINE
            ea63d3ad-8f7c-4494-b187-acb706cc4cb5  ONLINE
        logs
          mirror-1                                ONLINE
            67834c54-3d39-4e97-bf56-cd5399052df5  ONLINE
            eebe170a-b63e-4609-9b4b-c40700122fe9  ONLINE

Also zdb -l shows the same, and good information on the disks, so all pool information seem to be in good shape.

Trying to get some information from zpool logs, it shows some vdev.corrup, but no other details.

journalctl -b0 | grep -i zpool -C 2
Mar 27 08:43:39 openmediavault zed[3916]: eid=20 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=1615106048 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3928]: eid=21 class=vdev.corrupt_data pool='data'
Mar 27 08:43:39 openmediavault zed[3929]: eid=22 class=zpool pool='data'
Mar 27 08:43:39 openmediavault zed[3933]: eid=23 class=zpool pool='data'
Mar 27 08:44:42 openmediavault systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Mar 27 08:44:42 openmediavault systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.

Same for logs on ZFS, the last changed timestamp was from 10pm

journalctl -b0 | grep -i zfs -C 2
Mar 26 22:10:50 openmediavault kernel:  schedule+0x27/0xf0
Mar 26 22:10:50 openmediavault kernel:  spl_panic+0x115/0x120 [spl]
Mar 26 22:10:50 openmediavault kernel:  ? zap_lookup+0x56/0x110 [zfs]
Mar 26 22:10:50 openmediavault kernel:  spa_feature_enabled_txg+0x11f/0x130 [zfs]
Mar 26 22:10:50 openmediavault kernel:  traverse_impl+0x3c0/0x4c0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? __pfx_spa_load_verify_cb+0x10/0x10 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? kfree+0x24f/0x370
Mar 26 22:10:50 openmediavault kernel:  traverse_pool+0x68/0x1e0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? __pfx_spa_load_verify_cb+0x10/0x10 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? __pfx_spa_load_verify_cb+0x10/0x10 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? zio_root+0x33/0x40 [zfs]
Mar 26 22:10:50 openmediavault kernel:  spa_load+0xeab/0x1a70 [zfs]
Mar 26 22:10:50 openmediavault kernel:  spa_load_best+0x54/0x2c0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  spa_import+0x235/0x6e0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  zfs_ioc_pool_import+0x15b/0x180 [zfs]
Mar 26 22:10:50 openmediavault kernel:  zfsdev_ioctl_common+0x7ca/0x9d0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  ? __kvmalloc_node_noprof+0x40/0xd0
Mar 26 22:10:50 openmediavault kernel:  zfsdev_ioctl+0x53/0xe0 [zfs]
Mar 26 22:10:50 openmediavault kernel:  __x64_sys_ioctl+0x91/0xd0
Mar 26 22:10:50 openmediavault kernel:  do_syscall_64+0x82/0x190

I changed from TrueNAS to OpenMediaVault because when trying to import that pool on TrueNAS, it crashed the system and as I hoped to have more current ZFS version running, that could still import the data.
Now OpenMediaVault is not really crashing, when trying to import the pool, but zpool import takes really long (if not forever).

I tried

zpool import -o readonly=on data

but also that was not really successful even after 10 hours (was still stuck).

There was the same issue once reported, but it was closed without any change by the looks of it.
#10612

Currently I'm running

zpool import -fFX -R /mnt/test data

I hope you have some help.
Thanks!
@Chavell3 Chavell3 added the Type: Defect Incorrect behavior (e.g. crash, hang) label Mar 27, 2025
@Chavell3
Copy link
Author

Chavell3 commented Mar 27, 2025 •
edited
Loading

I was now able to import the pool on openmediavault.
But I would like to avoid that issue again, so would be great if we could look into this.

I found this additionally from the try to importing the pool as read-only:

journalctl | grep -i zed -C 2
Mar 26 21:46:02 openmediavault zed[2612]: eid=24 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:13
Mar 26 21:46:02 openmediavault zed[2615]: eid=25 class=vdev.corrupt_data pool='data'
Mar 26 21:46:02 openmediavault zed[2618]: eid=26 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:2
Mar 26 21:46:02 openmediavault zed[2620]: eid=27 class=vdev.corrupt_data pool='data'
Mar 26 21:46:02 openmediavault zed[2621]: eid=28 class=zpool pool='data'
Mar 26 21:46:02 openmediavault zed[2676]: eid=29 class=zpool pool='data'
Mar 26 21:46:25 openmediavault sshd[2706]: Accepted password for root from 192.168.4.73 port 54546 ssh2
Mar 26 21:46:25 openmediavault sshd[2706]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)
Mar 26 21:46:25 openmediavault sshd[2706]: pam_env(sshd:session): deprecated reading of user environment enabled
Mar 26 21:46:48 openmediavault zed[3131]: eid=30 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:13
Mar 26 21:46:48 openmediavault zed[3134]: eid=31 class=vdev.corrupt_data pool='data'
Mar 26 21:46:48 openmediavault zed[3139]: eid=34 class=zpool pool='data'
Mar 26 21:46:48 openmediavault zed[3137]: eid=33 class=vdev.corrupt_data pool='data'
Mar 26 21:46:48 openmediavault zed[3140]: eid=32 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:2
Mar 26 21:46:48 openmediavault zed[3193]: eid=35 class=zpool pool='data'
Mar 26 21:49:08 openmediavault zed[3594]: eid=36 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=3763879936 priority=0 err=52 flags=0x300080 bookmark=0:0:0:321
Mar 26 21:49:08 openmediavault zed[3598]: eid=37 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=3763879936 priority=0 err=52 flags=0x300080 bookmark=0:0:0:321
Mar 26 21:49:08 openmediavault zed[3602]: eid=38 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=1616785408 priority=0 err=52 flags=0x300080 bookmark=0:0:0:321
Mar 26 21:49:08 openmediavault zed[3604]: eid=39 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=1616785408 priority=0 err=52 flags=0x300080 bookmark=0:0:0:321
Mar 26 21:49:08 openmediavault zed[3606]: eid=40 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:2

that is after the zpool import -fFX -R command:

journalctl -b0 | grep -i zed -C 2
Mar 27 08:43:39 openmediavault zed[3835]: eid=6 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3840]: eid=7 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=5916758016 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3841]: eid=8 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=5916758016 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3845]: eid=10 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=3763937280 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3847]: eid=9 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=3763937280 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3850]: eid=11 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=1616875520 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3853]: eid=13 class=vdev.corrupt_data pool='data'
Mar 27 08:43:39 openmediavault zed[3855]: eid=12 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=1616875520 priority=0 err=52 flags=0x300080 bookmark=0:0:0:13
Mar 27 08:43:39 openmediavault zed[3860]: eid=14 class=data pool='data' priority=0 err=52 flags=0x1008081 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3895]: eid=16 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=5910052864 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3899]: eid=15 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=5910052864 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3902]: eid=17 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=3762339840 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3905]: eid=18 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=3762339840 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3911]: eid=19 class=checksum pool='data' vdev=ea63d3ad-8f7c-4494-b187-acb706cc4cb5 algorithm=fletcher4 size=4096 offset=1615106048 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3916]: eid=20 class=checksum pool='data' vdev=1afcdfa9-474b-4d3d-9cc5-496aa4f69453 algorithm=fletcher4 size=4096 offset=1615106048 priority=0 err=52 flags=0x300080 bookmark=0:0:0:2
Mar 27 08:43:39 openmediavault zed[3928]: eid=21 class=vdev.corrupt_data pool='data'
Mar 27 08:43:39 openmediavault zed[3929]: eid=22 class=zpool pool='data'
Mar 27 08:43:39 openmediavault zed[3933]: eid=23 class=zpool pool='data'
Mar 27 08:44:42 openmediavault systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Mar 27 08:44:42 openmediavault systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type: Defect Incorrect behavior (e.g. crash, hang)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Chavell3