openzfs/openzfs-docs

Base urls in /etc/yum.repos.d/yum.repos.d return 403 forbidden

maxkremer opened this issue · 6 comments

Steps to reproduce

I did this on amazon linux 2 which is based on rhel7 so I followed the instructions in the docs to download and install zfs on el7.

sudo yum install https://zfsonlinux.org/epel/zfs-release-2-2.el7.noarch.rpm

The above will create zfs.repo in /etc/yumrepos.d that looks like this:

[zfs]
name=ZFS on Linux for EL$releasever - dkms
baseurl=http://download.zfsonlinux.org/epel/$releasever/$basearch/
enabled=1
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-openzfs

[zfs-kmod]
name=ZFS on Linux for EL$releasever - kmod
baseurl=http://download.zfsonlinux.org/epel/$releasever/kmod/$basearch/
enabled=0
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-openzfs

[zfs-source]
name=ZFS on Linux for EL$releasever - Source
baseurl=http://download.zfsonlinux.org/epel/$releasever/SRPMS/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-openzfs

[zfs-testing]
name=ZFS on Linux for EL$releasever - dkms - Testing
baseurl=http://download.zfsonlinux.org/epel-testing/$releasever/$basearch/
enabled=0
metadata_expire=7d
gpgcheck=1

Attempt any one of the following yum installs

yum install -y epel-release
yum install -y kernel-devel
yum install -y zfs

You will get an error with the message:

failure: repodata/repomd.xml from zfs: [Errno 256] No more mirrors to try.
http://download.zfsonlinux.org/epel/2/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden

@tonyhutter could you please look at this issue?

http://download.zfsonlinux.org/epel/2/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden

Even though Amazon Linux 2 is based on RHEL 7, it's reporting a $releasever of 2 instead of 7. That explains the 2 in the URL and why it's not working.

You could try hardcoding 7 in place of $releasever in your /etc/yum.repos.d/zfs.repo and it might work.

Thanks Tony for your quick reply. I know that Amazon Linux 2 is no officially supported so I appreciate the help. Your suggestion worked and ZFS installed however I'm unable to load the ZFS modules. The following illustrates:

sudo yum install zfs
Loaded plugins: extras_suggestions, langpacks, priorities, update-motd
Existing lock /var/run/yum.pid: another copy is running as pid 20478.
Another app is currently holding the yum lock; waiting for it to exit...
  The other application is: yum
    Memory : 336 M RSS (553 MB VSZ)
    Started: Thu Apr 20 17:19:00 2023 - 00:12 ago
    State  : Running, pid: 20478
225 packages excluded due to repository priority protections
Resolving Dependencies
--> Running transaction check
---> Package zfs.x86_64 0:2.0.7-1.el7 will be installed
--> Processing Dependency: zfs-kmod = 2.0.7 for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libzpool4 = 2.0.7 for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libzfs4 = 2.0.7 for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libuutil3 = 2.0.7 for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libnvpair3 = 2.0.7 for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libzpool.so.4()(64bit) for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libzfs_core.so.3()(64bit) for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libzfs.so.4()(64bit) for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libuutil.so.3()(64bit) for package: zfs-2.0.7-1.el7.x86_64
--> Processing Dependency: libnvpair.so.3()(64bit) for package: zfs-2.0.7-1.el7.x86_64
--> Running transaction check
---> Package libnvpair3.x86_64 0:2.0.7-1.el7 will be installed
---> Package libuutil3.x86_64 0:2.0.7-1.el7 will be installed
---> Package libzfs4.x86_64 0:2.0.7-1.el7 will be installed
---> Package libzpool4.x86_64 0:2.0.7-1.el7 will be installed
---> Package zfs-dkms.noarch 0:2.0.7-1.el7 will be installed
--> Processing Dependency: dkms >= 2.2.0.3 for package: zfs-dkms-2.0.7-1.el7.noarch
--> Processing Dependency: gcc for package: zfs-dkms-2.0.7-1.el7.noarch
--> Running transaction check
---> Package dkms.noarch 0:2.6.1-1.amzn2.0.1 will be installed
--> Processing Dependency: yum-plugin-dkms-build-requires for package: dkms-2.6.1-1.amzn2.0.1.noarch
---> Package gcc.x86_64 0:7.3.1-15.amzn2 will be installed
--> Processing Dependency: cpp = 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libsanitizer >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libquadmath >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libmpx >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libitm >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libcilkrts >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Processing Dependency: libatomic >= 7.3.1-15.amzn2 for package: gcc-7.3.1-15.amzn2.x86_64
--> Running transaction check
---> Package cpp.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libatomic.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libcilkrts.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libitm.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libmpx.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libquadmath.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package libsanitizer.x86_64 0:7.3.1-15.amzn2 will be installed
---> Package yum-plugin-dkms-build-requires.noarch 0:1.0-2.amzn2 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

======================================================================================================================================================
 Package                                           Arch                      Version                              Repository                     Size
======================================================================================================================================================
Installing:
 zfs                                               x86_64                    2.0.7-1.el7                          zfs                           595 k
Installing for dependencies:
 cpp                                               x86_64                    7.3.1-15.amzn2                       amzn2-core                    9.2 M
 dkms                                              noarch                    2.6.1-1.amzn2.0.1                    amzn2-core                     75 k
 gcc                                               x86_64                    7.3.1-15.amzn2                       amzn2-core                     22 M
 libatomic                                         x86_64                    7.3.1-15.amzn2                       amzn2-core                     46 k
 libcilkrts                                        x86_64                    7.3.1-15.amzn2                       amzn2-core                     85 k
 libitm                                            x86_64                    7.3.1-15.amzn2                       amzn2-core                     85 k
 libmpx                                            x86_64                    7.3.1-15.amzn2                       amzn2-core                     51 k
 libnvpair3                                        x86_64                    2.0.7-1.el7                          zfs                            32 k
 libquadmath                                       x86_64                    7.3.1-15.amzn2                       amzn2-core                    189 k
 libsanitizer                                      x86_64                    7.3.1-15.amzn2                       amzn2-core                    642 k
 libuutil3                                         x86_64                    2.0.7-1.el7                          zfs                            26 k
 libzfs4                                           x86_64                    2.0.7-1.el7                          zfs                           219 k
 libzpool4                                         x86_64                    2.0.7-1.el7                          zfs                           1.2 M
 yum-plugin-dkms-build-requires                    noarch                    1.0-2.amzn2                          amzn2-core                    6.6 k
 zfs-dkms                                          noarch                    2.0.7-1.el7                          zfs                            11 M

Transaction Summary
======================================================================================================================================================
Install  1 Package (+15 Dependent packages)

Total download size: 45 M
Installed size: 135 M
Is this ok [y/d/N]: y
Downloading packages:
(1/16): dkms-2.6.1-1.amzn2.0.1.noarch.rpm                                                                                      |  75 kB  00:00:00     
(2/16): cpp-7.3.1-15.amzn2.x86_64.rpm                                                                                          | 9.2 MB  00:00:00     
(3/16): libatomic-7.3.1-15.amzn2.x86_64.rpm                                                                                    |  46 kB  00:00:00     
(4/16): libcilkrts-7.3.1-15.amzn2.x86_64.rpm                                                                                   |  85 kB  00:00:00     
(5/16): libitm-7.3.1-15.amzn2.x86_64.rpm                                                                                       |  85 kB  00:00:00     
(6/16): libmpx-7.3.1-15.amzn2.x86_64.rpm                                                                                       |  51 kB  00:00:00     
(7/16): libquadmath-7.3.1-15.amzn2.x86_64.rpm                                                                                  | 189 kB  00:00:00     
(8/16): libsanitizer-7.3.1-15.amzn2.x86_64.rpm                                                                                 | 642 kB  00:00:00     
(9/16): gcc-7.3.1-15.amzn2.x86_64.rpm                                                                                          |  22 MB  00:00:00     
warning: /var/cache/yum/x86_64/2/zfs/packages/libnvpair3-2.0.7-1.el7.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID f14ab620: NOKEY
Public key for libnvpair3-2.0.7-1.el7.x86_64.rpm is not installed
(10/16): libnvpair3-2.0.7-1.el7.x86_64.rpm                                                                                     |  32 kB  00:00:00     
(11/16): libuutil3-2.0.7-1.el7.x86_64.rpm                                                                                      |  26 kB  00:00:00     
(12/16): yum-plugin-dkms-build-requires-1.0-2.amzn2.noarch.rpm                                                                 | 6.6 kB  00:00:00     
(13/16): libzfs4-2.0.7-1.el7.x86_64.rpm                                                                                        | 219 kB  00:00:00     
(14/16): libzpool4-2.0.7-1.el7.x86_64.rpm                                                                                      | 1.2 MB  00:00:00     
(15/16): zfs-2.0.7-1.el7.x86_64.rpm                                                                                            | 595 kB  00:00:00     
(16/16): zfs-dkms-2.0.7-1.el7.noarch.rpm                                                                                       |  11 MB  00:00:00     
------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                  48 MB/s |  45 MB  00:00:00     
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-openzfs
Importing GPG key 0xF14AB620:
 Userid     : "ZFS on Linux <zfs@zfsonlinux.org>"
 Fingerprint: c93a fffd 9f3f 7b03 c310 ceb6 a9d5 a1c0 f14a b620
 Package    : zfs-release-2-2.el7.noarch (installed)
 From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-openzfs
Is this ok [y/N]: y
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : libnvpair3-2.0.7-1.el7.x86_64                                                                                                     1/16 
  Installing : libuutil3-2.0.7-1.el7.x86_64                                                                                                      2/16 
  Installing : libzfs4-2.0.7-1.el7.x86_64                                                                                                        3/16 
  Installing : libzpool4-2.0.7-1.el7.x86_64                                                                                                      4/16 
  Installing : libmpx-7.3.1-15.amzn2.x86_64                                                                                                      5/16 
  Installing : libcilkrts-7.3.1-15.amzn2.x86_64                                                                                                  6/16 
  Installing : libsanitizer-7.3.1-15.amzn2.x86_64                                                                                                7/16 
  Installing : libatomic-7.3.1-15.amzn2.x86_64                                                                                                   8/16 
  Installing : libquadmath-7.3.1-15.amzn2.x86_64                                                                                                 9/16 
  Installing : yum-plugin-dkms-build-requires-1.0-2.amzn2.noarch                                                                                10/16 
  Installing : libitm-7.3.1-15.amzn2.x86_64                                                                                                     11/16 
  Installing : cpp-7.3.1-15.amzn2.x86_64                                                                                                        12/16 
  Installing : gcc-7.3.1-15.amzn2.x86_64                                                                                                        13/16 
  Installing : dkms-2.6.1-1.amzn2.0.1.noarch                                                                                                    14/16 
  Installing : zfs-dkms-2.0.7-1.el7.noarch                                                                                                      15/16 
Loading new zfs-2.0.7 DKMS files...
Building for 5.10.167-147.601.amzn2.x86_64
Module build for kernel 5.10.167-147.601.amzn2.x86_64 was skipped since the
kernel headers for this kernel does not seem to be installed.
  Installing : zfs-2.0.7-1.el7.x86_64                                                                                                           16/16 
  Verifying  : cpp-7.3.1-15.amzn2.x86_64                                                                                                         1/16 
  Verifying  : zfs-dkms-2.0.7-1.el7.noarch                                                                                                       2/16 
  Verifying  : zfs-2.0.7-1.el7.x86_64                                                                                                            3/16 
  Verifying  : libitm-7.3.1-15.amzn2.x86_64                                                                                                      4/16 
  Verifying  : yum-plugin-dkms-build-requires-1.0-2.amzn2.noarch                                                                                 5/16 
  Verifying  : libuutil3-2.0.7-1.el7.x86_64                                                                                                      6/16 
  Verifying  : libquadmath-7.3.1-15.amzn2.x86_64                                                                                                 7/16 
  Verifying  : libatomic-7.3.1-15.amzn2.x86_64                                                                                                   8/16 
  Verifying  : libsanitizer-7.3.1-15.amzn2.x86_64                                                                                                9/16 
  Verifying  : libzpool4-2.0.7-1.el7.x86_64                                                                                                     10/16 
  Verifying  : gcc-7.3.1-15.amzn2.x86_64                                                                                                        11/16 
  Verifying  : libcilkrts-7.3.1-15.amzn2.x86_64                                                                                                 12/16 
  Verifying  : dkms-2.6.1-1.amzn2.0.1.noarch                                                                                                    13/16 
  Verifying  : libzfs4-2.0.7-1.el7.x86_64                                                                                                       14/16 
  Verifying  : libmpx-7.3.1-15.amzn2.x86_64                                                                                                     15/16 
  Verifying  : libnvpair3-2.0.7-1.el7.x86_64                                                                                                    16/16 

Installed:
  zfs.x86_64 0:2.0.7-1.el7                                                                                                                            

Dependency Installed:
  cpp.x86_64 0:7.3.1-15.amzn2                  dkms.noarch 0:2.6.1-1.amzn2.0.1                             gcc.x86_64 0:7.3.1-15.amzn2                
  libatomic.x86_64 0:7.3.1-15.amzn2            libcilkrts.x86_64 0:7.3.1-15.amzn2                          libitm.x86_64 0:7.3.1-15.amzn2             
  libmpx.x86_64 0:7.3.1-15.amzn2               libnvpair3.x86_64 0:2.0.7-1.el7                             libquadmath.x86_64 0:7.3.1-15.amzn2        
  libsanitizer.x86_64 0:7.3.1-15.amzn2         libuutil3.x86_64 0:2.0.7-1.el7                              libzfs4.x86_64 0:2.0.7-1.el7               
  libzpool4.x86_64 0:2.0.7-1.el7               yum-plugin-dkms-build-requires.noarch 0:1.0-2.amzn2         zfs-dkms.noarch 0:2.0.7-1.el7              

Complete!
[ec2-user@ip-172-31-51-199 ~]$ lsblk
NAME          MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
nvme1n1       259:0    0  50G  0 disk 
nvme0n1       259:1    0   8G  0 disk 
├─nvme0n1p1   259:3    0   8G  0 part /
└─nvme0n1p128 259:4    0   1M  0 part 
nvme2n1       259:2    0  50G  0 disk 
[ec2-user@ip-172-31-51-199 ~]$ sudo zpool create -o ashift=9 pgtank nvme1n1 nvme2n1
The ZFS modules are not loaded.
Try running '/sbin/modprobe zfs' as root to load them.
[ec2-user@ip-172-31-51-199 ~]$ sudo /sbin/modprobe zfs
modprobe: FATAL: Module zfs not found in directory /lib/modules/5.10.167-147.601.amzn2.x86_64

Curios that the error Module build for kernel 5.10.167-147.601.amzn2.x86_64 was skipped since the kernel headers for this kernel does not seem to be installed. was triggered because the kernel headers are indeed installed.

ne9z commented

You need to install the kernel-headers package, as indicated by the output of yum command:

And if that doesn't work for you, you could also try disabling the 'zfs' repo and enable the 'zfs-testing' repo in /etc/yum.repos.d/zfs.repo. 'zfs-testing' will give you the newest zfs-2.1.11, which may be more compatible with Amazon's kernel.

my bad - i did a yum update and rebooted and everything works fine, successfully created a zfs pool on 2 ebs volumes. Thanks for the support.